Associate Data Engineer
Tasks
- Assist with AI ML data preparation feature engineering dataset creation and model input preparation
- Build scalable ETL ELT workflows for analytics reporting and machine learning
- Collaborate with data engineers, analysts, and data scientists
- Create and maintain documentation for data pipelines and workflows
- Develop, test, and maintain data pipelines
- Follow version control code quality testing and deployment best practices
- Ingest transform and process structured and semi structured data
- Monitor scheduled jobs and workflows for timely delivery
- Optimize Spark jobs and Databricks notebooks for performance reliability and cost
- Perform data cleansing validation and quality checks
- Troubleshoot pipeline failures data issues and performance bottlenecks
Perks/Benefits
- N/A
Skills/Tech-stack
AI | AWS | Azure | Batch Processing | CI/CD | CSV | Data Cleansing | Data Lakes | Data Pipelines | Data Quality | Data Validation | Data Warehousing | Databricks | Databricks Jobs | Databricks Notebooks | Delta | Delta Lake | Delta Tables | ELT | ETL | Feature Engineering | GCP | Git | JSON | Lakehouse | Machine Learning | Parquet | PySpark | Python | SQL | Spark
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Data Engineering | Bachelor of Science in Engineering | Bachelor of Science in Information Systems | Bachelor of Science in Mathematics
Roles
Data Engineer | Data Pipeline Engineer | Engineer | Pipeline Engineer
Related jobs
-
Sr. Digital Solution Engineer - Data & Analytics INR 2520K-3380KAzure | Azure Data | Azure Data Factory | Azure SQL | Azure SynapseSenior-level Full TimeBengaluru, KA, IN; Mumbai, MH, IN5h ago
-
Mid-level Full TimeGurugram, Haryana, India7h ago
-
Sr. Software Engineer (AI/ML) (PhD / Postdoc) INR 1500K-2400KCausal Inference | Deep learning | Generative AI | Language Processing | Machine LearningAccess to large clinical dataset | Collaboration with healthcare partners | Conference publication support | Research freedomSenior-level Full TimeHyderabad, India8h ago
-
Mid-level Full TimeGurugram, Haryana, India8h ago
-
AI | AWS | Agile | Ansible | AutosysSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Business Intelligence Engineer, Last Mile Analytics INR 1800K-2400KAmazon QuickSight | Data Analysis | Data Interpretation | Data Visualization | NoSQLMid-level Full TimeHyderabad, Telangana, IND13h ago
-
IT Data Engineer II INT INR 1800K-2500KApache Spark | Cloud Cost Optimization | Cloud platform | Cost Optimization | Data GovernanceMid-level Full TimeBangalore, India13h ago
-
Data Engineer - VOIS INR 2000K-2040KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerCollaborative environment | Flexible inclusive workplace | Learning opportunitiesMid-level Full TimePune, IN13h ago
-
AWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon S3 | Amazon Web ServicesEqual opportunity employer | Fast track growth opportunities | Great place to workSenior-level Full TimeHyderabad, Office Level 3 & 4, …13h ago
-
TTT-SAP-Python Gen AI-Tax Senior INR 2000K-4512KAI Core | AI Launchpad | API Management | CI/CD | Cloud ALMSenior-level Full TimeBengaluru, KA, IN, 56001613h ago
-
Entry-level Full TimeBangalore, India13h ago
-
Senior-level Full TimeBangalore, KA, IN13h ago
-
Deputy Manager, Global Platform Technology INR 1500K-2000KAgile | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DBMid-level Full TimeChennai IMPT, India13h ago
-
Senior-level Full TimeIndia - Chennai13h ago
-
Data engineer (Azure Databricks) INR 1500K-2500KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeChennai, Tamil Nadu, India13h ago
-
Data Engineer INR 3000K-4000KAgile | Azure | Azure IAM | Azure Networking | Azure StorageBe Well programs | Certification support | Coaching | Continuous feedback | Hybrid workMid-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India13h ago
-
Data Engineering Lead - MSC INR 2520K-3380KAbinitio | Airflow | Azure Data | Azure Data Factory | Azure Data LakeRelocation supportSenior-level Full TimeBusiness Office (Joy House 2) - …13h ago
-
Associate Data Engineer INR 1500K-2000KAWS | CCPA | Data Architecture | Data Governance | Data ModelingMid-level Full TimeIndia - Hyderabad13h ago
-
ALSA | ARM | ARM RealView ICE | Audio CODEC | Bad Block ManagementSenior-level Full TimeTamil Nadu, Tamil Nadu, India13h ago
-
Senior AI/ML Engineer INR 2500K-5000KAI Document Intelligence | AI Services | API Design | Agent Orchestration | Agent systemsSenior-level Full TimeBangalore - RGA Tech Park, India13h ago
-
Software Engineering LMTS- ML Engineer INR 2500K-4500KEmbeddings | Fine Tuning | LLM | Machine Learning | Machine Learning PipelinesSenior-level Full TimeIndia - Bangalore13h ago
-
Senior SQL Developer + SSIS + POWER BI INR 3000K-4000KAgile Scrum | BI Desktop | Composite Models | DAX | Data ModelingSenior-level Full TimeMumbai, India13h ago
-
Associate Database Reliability Engineer INR 1200K-2500KBash | CentOS | Cloud infrastructure | DNS | DRSMid-level Full TimePune, India13h ago
-
Software Development Engineer 1 INR 2200K-4200KAI Agents | AWS | Azure | CI/CD | DockerContinuous learning | Flexible experimentation | Innovation culture | Mentorship | Open collaborationNone Full TimeAPAC - India - Bengaluru - …13h ago
-
Software Development Engineer 4 INR 2500K-4500KAWS EMR | Airflow | Apache Spark | Data Ingestion | Data LakeSenior-level Full TimeNoida, India R13h ago