Expert Data & AI Engineer
Tasks
- Collaborate with data modelers and business partners
- Deploy automated CI CD pipelines across environments
- Design data pipeline architectures
- Develop modular data transformation code
- Implement data ingestion transformation and storage
- Maintain and upgrade data pipelines
- Monitor pipeline performance
- Oversee team projects and initiatives
- Perform automated data quality testing and validation
- Run ETL from source systems
- Troubleshoot pipeline issues
Perks/Benefits
- Career development opportunities
- Collaborative culture
- Learning opportunities
- Team leadership opportunities
Skills/Tech-stack
AWS | Apache Spark | Automation | Azure | Azure DevOps | CI/CD | Code Testing | DBT | Data Governance | Data Quality | Data Quality Testing | Data Standards | Data Validation | Data integration | Data principles | Databricks | ETL | FAIR-Data | Fair Data Principles | Git | Infrastructure as Code | PySpark | Python | Quality testing | SQL | “as-code”
Education
N/A
Related jobs
-
AWS | Amazon Aurora | Amazon RDS | Amazon S3 | CI/CDMid-level Full TimeDahisar West, Maharashtra4h ago
-
Data Platform Operations Engineer (Databricks, DBT, Snowflake, AWS, Aurora) - Mumbai, MH - AS A INR 1300K-2000KAmazon Aurora | Amazon S3 | Amazon Web Services | Backup and Recovery | CDCMid-level Full TimeMumbai, MH4h ago
-
DevOps / AWS Data Platform Engineer (Databricks, Snowflake, Aurora, S3, DBT) - Mumbai, MH - AS A INR 1500K-2500KAWS S3 | Alerting | Amazon Aurora | Amazon RDS | Amazon Web ServicesMid-level Full TimeMumbai, MH4h ago
-
Apache Spark | Data Pipelines | Data Validation | Databricks | Feature EngineeringMid-level Full TimeMumbai, MH4h ago
-
Software Engineer III - Python INR 3000K-5000KAlerting | CI/CD | Docker | Infrastructure as Code | KubernetesSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde7h ago
-
Agentic AI | Agile | Artificial Intelligence | Docker | Generative AISenior-level ContractShaikpet, India7h ago
-
Senior AI Engineer / Data Scientist (Agentic AI) INR 2000K-5000KAI Search | AI Services | Agentic AI | Azure | Azure AISenior-level Full TimeChennai, India7h ago
-
Senior-level Full TimeIN-KA-Bangalore8h ago
-
GenAI Developer INR 1800K-4500KAPI Development | AWS | Azure | C++ | Cloud platformFull-time work | Work from OfficeSenior-level Full TimeIN-TN-Chennai8h ago
-
Expert Data Engineer INR 3500K-4200KAPI Integration | Access Control | Attribute-Based Access Control | Attribute-based access | Audit LoggingHybrid workSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India8h ago
-
Agile | Apache Airflow | Azure Data | Azure Data Factory | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India9h ago
-
Data Science Manager I, AI/ML INR 2500K-5000KAdverse impact analysis | Agent Development | Applied Mathematics | Data Modeling | Database queryingSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Application Engineer, Master Data Governance INR 1000K-1500KABAP | Data Governance | Data Management | Fiori | Master DataMid-level Full TimeHyderabad, Telangana, India9h ago
-
Staff Software Engineer, Machine Learning INR 3000K-4680KC++ | Cross-Functional Collaboration | Cross-functional | Data Pipelines | Fine TuningHealth and wellness programs | Time awaySenior-level Full TimeBengaluru, KA, India10h ago
-
Mid-level Full TimeBangalore, Karnataka, IN10h ago
-
Senior AI Engineer INR 2500K-5000KAPI Design | Agile | Azure | Azure AI | Azure ArcHybrid work | On-call supportSenior-level Full TimeBangalore, Karnataka, IN10h ago
-
Manager, Data Product Management INR 2500K-4720KAlerting | Apache Airflow | Apache Beam | Automation | BigQuerySenior-level Full TimeChennai, Tamil Nadu, India10h ago
-
Lead Expert Data Engineer- Procurement INR 3000K-4000KAWS | Apache Spark | Azure | Azure DevOps | CI/CDSenior-level Full TimeHyderabad, India11h ago
-
Senior-level Full TimeHyderabad, Telangana, India11h ago
-
Principal Software Engineer INR 2000K-4800KAlgorithms | Auditability | Automation | Azure | Cause analysisSenior-level Full TimeIndia, Karnataka, Bangalore11h ago
-
Data Engineer - Associate Director INR 1500K-2600KAWS | AWS Glue | Agile | Apache Airflow | Apache HadoopMid-level Full TimeBangalore, Karnataka, India11h ago
-
Software Engineer III - ( Java , Python) INR 2000K-3500KAI Assisted Development | AWS | Agile | CI/CD | JavaSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Entry-level Full TimeHyderabad12h ago