AI Engineer, Data Pipeline - 11318
Tasks
- Build automated data export jobs
- Build data ingestion pipelines
- Document data lineage schemas and transformations
- Implement data cleansing routines
- Monitor pipeline health troubleshoot failures
- Optimize pipeline performance
- Perform data validation and quality checks
- Support feature extraction from enterprise schemas
- Write and maintain ETL jobs
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon S3 | Avro | Data Quality | Data Testing | Data Validation | ELT | ETL | JSON | MySQL | Parquet | PostgreSQL | PySpark | Python | SQL | Spark
Education
Roles
AI | AI Engineer | Data Engineer | Engineer
Related jobs
-
Staff Software Engineer, Machine Learning INR 2520K-3880KA/B | A/B Testing | Alerting | B testing | BackpressureEqual opportunity workplace | Health and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India4h ago
-
Sr. Staff Software Engineer, Machine Learning INR 3200K-4725KC++ | Data Pipelines | Deep learning | Experimentation | Generative AIHealth and wellness programs | Time away from workSenior-level Full TimeBengaluru, KA, India4h ago
-
Principal Staff Software Engineer, Machine Learning INR 1800K-4000KA/B | A/B Testing | B testing | Backpressure Control | CachingHealth and wellness programs | Time awayExecutive-level Full TimeBengaluru, KA, India4h ago
-
Data Scientist I INR 2520K-4500KAWS | Amazon Bedrock | Amazon SageMaker | Autogen | BERTCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600665h ago
-
Senior-level Full TimePune, India6h ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R11h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India11h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India11h ago
-
EY - GDS Consulting - AI And DATA -Azure Databricks - Senior INR 2040K-2400KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCoaching and feedback | Flexible working arrangements | Professional development opportunitiesSenior-level Full TimeBengaluru, KA, IN, 56001611h ago
-
Senior-level Full TimeGurugram, India18h ago
-
Mid-level Full TimeGurugram, India18h ago
-
Software Engineer III - Data INR 2520K-3380KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureERG events | Equipment provided | Health coverage | Learning and development | Paid HolidaysSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Senior Data & Analytics Systems Engineer INR 2520K-3380KApache Airflow | Apache Spark | Cloud Functions | Cloud Storage | Cloud platformSenior-level Full TimeGurugram, India19h ago
-
Mid-level Full TimeGurugram, India20h ago
-
FinOps Data Engineer INR 2520K-3380KAPI Gateway | AWS Glue | Agile | Amazon Athena | Amazon RedshiftSenior-level Full TimeGurugram, India20h ago
-
Senior Data Engineer INR 2520K-3380KAirflow | Apache Dataproc | CI/CD | Databricks | DataformDiversity & inclusion culture | Growth opportunitiesSenior-level Full TimeGurugram, India20h ago
-
Senior-level Full TimeGurugram, India20h ago
-
Senior Data Governance Engineer INR 2520K-3356KCloud platform | Collibra | Data Catalog | Data Governance | Data LineageSenior-level Full TimeGurugram, India20h ago
-
Data & Analytics Systems Engineer INR 2700K-3880KApache Airflow | Apache Spark | BigQuery | Cloud Functions | Cloud StorageMid-level Full TimeGurugram, India20h ago
-
Analytics Engineer INR 2520K-3380KBigQuery | Cloud platform | Data Modeling | Data Warehousing | Enterprise Performance ManagementEntry-level Full TimeGurugram, India20h ago
-
Analytics Engineer INR 2520K-3380KBigQuery | Cloud platform | Data Modeling | Data Warehousing | Enterprise Performance ManagementCareer development | Diversity and inclusion | Flexible work environment | Reward and recognitionMid-level Full TimeGurugram, India20h ago
-
Senior Data Scientist #3081 INR 2500K-3200KAWS SageMaker | Azure ML | Azure OpenAI | CI/CD | DatabricksFlexible working hours | Global collaboration opportunities | Professional development programs | Recognition programsSenior-level Full TimeChennai, India21h ago
-
AI Knowledge & Execution Grounding Specialist INR 1600K-2500KData decoding | Hierarchical data | Hierarchical data decoding | JSON | LangchainMid-level Full TimeBangalore North, India21h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KAI/ML | CD pipelines | CI/CD | CI/CD pipelines | DockerCompetitive INR salary | Innovative projects | Legal presence in India | Local meet-ups | Remote workSenior-level Full TimePune City, India22h ago
-
AI ML Proactive INR 2500K-3500KAI Stack | API Integration | Agent Builder | BigQuery Vector Search | Cloud ArchitectureSenior-level Full TimeIN-AP-Hyderabad22h ago