Data Engineer II - Confluent
Tasks
- Build and operate data pipelines
- Design batch pipelines
- Design streaming pipelines
- Develop AI assisted data utilities
- Ensure data quality and testing
- Implement monitoring and observability
- Improve CI CD for data pipelines
- Manage cloud governance with IAM
- Manage secrets and cost optimization
- Mentor engineers through code review
- Own data models and SLAs
- Perform incident response and root cause analysis
- Transform data for data products
- Translate requirements into deliverables
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Iceberg | Atlan | CI/CD | Claude Code | Cloud Composer | DBT | Data Lineage | Data Quality | Data Warehousing | Datahub | Delta Lake | Dimensional Modeling | ELT | ETL | Feast | Feature Store | Flink | GCP | Great Expectations | Kafka | LLMOps | MLOps | Natural Language | Natural language interfaces | Observability | PGVector | Pinecone | Python | RAG | SQL | Tecton | Terraform | Text-to-SQL | Unity Catalog | Vector Databases | Weaviate
Roles
Related jobs
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R3h ago
-
Senior Staff Engineer (AI Full-stack Developer) INR 2000K-5000KAWS | Access Controls | Agentic Workflows | Asynchronous programming | Audit LoggingSenior-level Full TimeMumbai, India21h ago
-
Senior Staff Engineer (AI Solution Design) INR 4000K-5500KAlerting | Artificial Intelligence | Data Architecture | Data Lakes | Data PipelinesSenior-level Full TimeMumbai, India22h ago
-
AI Engineer INR 2000K-4500KAI Foundry | AI Services | API Development | Azure AI | Azure AI FoundryMid-level Full TimeBangalore, IN1d ago
-
Senior Data Engineer - Consulting INR 2500K-4000KAJAX | AWS ECS | Agile | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, Telangana1d ago
-
Data Engineer - Delivery INR 1500K-2000KAmazon Web Services | Azure Blob | Azure Blob Storage | Blob Storage | Data ManagementCollaborative team | Professional growth | Training completionMid-level Full TimeHyderabad, Telangana1d ago
-
Senior-level Full TimeBengaluru, KA, IN1d ago
-
Sr SDE (Java + AI) INR 3000K-5000KAI orchestration | AWS | Alerting | Automated testing | AzureDesign review leadership | MentorshipSenior-level Full TimePune City, India1d ago
-
Embedded Software Development Engineer (8-10 Years) INR 3200K-4110KAUTOSAR | Agile | Assembly | Automated testing | Automotive SPICESenior-level Full TimeBengaluru, India2d ago
-
Data Scientist - GenAi-AgenticAi INR 2500K-5000KAI orchestration | AWS | Agentic AI | Crew AI | Data MiningSenior-level Full TimeIndia2d ago
-
Senior-level Full TimeIndia - Bangalore2d ago
-
Staff Software Engineer - Data Platform INR 3000K-4000KAWS | Azure | Bazel | BigQuery | BuildkiteCell phone stipend | Free food | Holidays | In-office collaboration | Medical insuranceSenior-level Full TimeBengaluru, Karnataka, India, APAC2d ago
-
Senior-level Full TimeMumbai, MH, IN, 4000722d ago
-
Senior AI Engineer – Data Science & Generative AI INR 2000K-5000KAPI Development | AWS | Agentic AI | Asynchronous programming | AutogenSenior-level Full TimeBengaluru, KA, IN2d ago
-
Lead Engineer - Embedded Software INR 1716K-2400KBuild environment | C# | C++ | CAN | Cloud IntegrationEmployee assistance program | Flexible schedule | Health insurance | Leave policy | Professional development opportunitiesSenior-level Full TimeBuilding No: 12C, Floor 9,10,11, Building …2d ago
-
Lab and Center Data Engineer INR 938K-1408KAnsible | Bash | Enterprise Linux | Infrastructure as Code | KVMMid-level Full TimePune, Maharashtra, India2d ago
-
Lead Data Engineer INR 1500K-2500KApache Airflow | Apache Kafka | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIndia2d ago
-
Senior-level Full TimeHyderabad, IND-TG, India2d ago
-
Planview Administration 169576 INR 1500K-2500KData Governance | Data Modeling | Data Pipelines | Data Validation | ELTSenior-level Full TimeHyderabad, IND-TG, India2d ago
-
Senior-level Full TimeChennai, Tamil Nādu, India2d ago
-
AI / ML Developer / Engineer INR 2000K-3000KAI Agent | AI agent orchestration | Agent Orchestration | Artifact Registry | Backup and Disaster RecoveryMid-level Full TimeIndia2d ago
-
GCP Backend Developer / Engineer INR 3000K-5000KAgile | BigQuery | CI/CD | Cloud Functions | Cloud RunSenior-level Full TimeIndia2d ago
-
Software Engineer II INR 2771K-4000KAlgorithms | Amazon Web Services | Cloud platform | Data Structures | Distributed SystemsComprehensive health and wellbeing support | Learning and development opportunitiesEntry-level Full TimeGurugram, HR, India2d ago
-
Sr.DataOPS Developer INR 2000K-3000KAWS Greengrass | Airflow | Apache Flink | Apache Kafka | Apache Kafka StreamsSenior-level Full TimeBangalore, India2d ago
-
AI Engineer - India INR 1800K-3000KAzure APIM | Cloud platform | Cypher | Embeddings | FastAPICareer pathing | Flexi benefit plan | Focus time Fridays | Food at work | Group medical coverageMid-level Full TimeChennai R2d ago