Data Engineer II
Tamil Nadu, Chennai, India
INR 1500K-2200K (estimate) Mid-level Full Time
Tasks
- Architect distributed data processing solutions
- Build and maintain ETL pipelines
- Define and maintain data quality metrics
- Develop real-time data processing solutions
- Implement Application Performance Monitoring
- Implement data partitioning and indexing strategies
- Implement data validation and security best practices
- Lead data pipeline design development optimization
- Mentor junior engineers
- Optimize data storage strategies
- Support architectural decisions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | Amazon Athena | Amazon DynamoDB | Amazon S3 | Apache Airflow | Apache Kafka | Apache Spark | Avro | CI/CD | Cassandra | Chromium | Datadog | Docker | Elasticsearch | Event Driven | Event-driven architecture | Flink | Grafana | HBase | HDFS | HTTP | Hadoop | Infrastructure as Code | Jenkins | Kafka | Kafka Streams | Kubernetes | New Relic | Node.js | ORC | Parquet | Playwright | Prometheus | Puppeteer | PySpark | Redis | SQL | Spark Streaming | Terraform | Web Crawling | “as-code”
Education
N/A
Roles
Related jobs
-
AI Engineer / AI Developer INR 1800K-3300KAI Agents | Alerting | Amazon SQS | Async Programming | CI/CDSenior-level Full TimeBangalore, India Office (BANGALORE) R10h ago
-
AI Engineer – Python & Snowflake INR 1800K-2700KAPI Development | AWS | Airflow | Azure | Data ModelingMid-level Full TimeHyderabad, Hyderabad, IN11h ago
-
Senior AI Engineer (Full-Stack) (Remote) INR 2500K-5000KAWS | Active Directory | Anthropic | ArcGIS REST | ArcGIS REST APIClient facing ownership | Remote workSenior-level Full TimeMaharashtra, Pune, India R11h ago
-
Senior Database Engineer - #3180 (Remote) INR 1500K-2700KAWS CDK | AWS IAM | AWS KMS | Amazon Aurora | Amazon CloudFormationSenior-level Full TimeChennai, India R11h ago
-
Lead AI Software Engineer INR 2000K-4500KAI Agents | AWS | Azure | CI/CD | Cloud platformCareer growth | Career growth in technology domain | Continuous learningSenior-level Full TimePune City, India12h ago
-
Entry-level Full TimeCoimbatore, India12h ago
-
Senior-level Full TimeHyderabad, India12h ago
-
Entry-level Full TimeCoimbatore, India12h ago
-
Senior-level Full TimeIN-HR-Gurgaon12h ago
-
Senior-level Full TimeIN-KA-Bangalore12h ago
-
Senior Engineer - Embedded QA INR 1500K-2094KAgile | CI/CD | Continuous Deployment | Continuous integration | Data Driven TestingSenior-level Full TimeHadapsar, Pune, Maharashtra, IND, 411013 R13h ago
-
Senior Software Engineer (AI,Java/Python) INR 2475K-3500KAPI Development | AWS | Agent Frameworks | Agent systems | Amazon SQSFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Wellness supportSenior-level Full TimeHyderabad, India15h ago
-
Access Control | Autogen | CI/CD | Chroma | Continuous MonitoringEntry-level Full TimeHyderabad, Telangana, India15h ago
-
DevOps Track Sr.Engineer INR 2229K-4000KAPI Gateway | APM | AWS CloudWatch | AWS Systems Manager | AWS systemsSenior-level Full TimeIndia15h ago
-
Database Track Sr.Engineer INR 2000K-3000KData Architecture | Database Schemas | Database performance | Database performance tuning | Disaster RecoverySenior-level Full TimeIndia15h ago
-
Big Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Factory | Data Factory | Data IngestionSenior-level Full TimeIndia15h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Services | Anthropic | Azure AI | Azure AI Services | CI/CDExecutive-level Full TimeIndia15h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Search | AI Services | Anthropic | Azure AI | Azure AI ServicesExecutive-level Full TimeIndia15h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Services | Anthropic | Azure AI | Azure AI Services | CI/CDExecutive-level Full TimeIndia15h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Services | Anthropic | Azure AI | Azure AI Services | CI/CDExecutive-level Full TimeIndia15h ago
-
Lead-Affluent BIU & Analytics-AFFLUENT-Program & MIS INR 2000K-3500KA/B | A/B Testing | B testing | Clustering | Data WarehousingSenior-level Full TimeMumbai, Maharashtra, India15h ago
-
Big Data Lead INR 1500K-2000KAzure Data | Azure Data Lake | Azure Data Lake Storage | CI/CD | Cloud StorageSenior-level Full TimeIndia15h ago
-
Amaze - Cloud Data Architect INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeIndia15h ago
-
Big Data Lead INR 2000K-3000KApache Airflow | Apache Beam | Apache Spark | BigQuery | Cloud ComposerSenior-level Full TimeIndia15h ago
-
Big Data Engineer INR 1500K-2000KApache Airflow | Apache Beam | Apache Spark | BigQuery | Cloud ComposerMid-level Full TimeIndia15h ago