Data Engineer, II
IND - Pune, India
INR 1500K-2750K (estimate) Mid-level Full Time
Tasks
- Automate data pipelines
- Build data pipeline workflows
- Cleanse data
- Conduct performance testing
- Create data validation tests
- Design data pipelines
- Develop PySpark data transformations
- Maintain technical documentation
- Minimize pipeline cost
- Optimize pipeline performance
- Perform code profiling
- Transform data
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Airflow | Apache Airflow | Azure | Dask | Data Validation | Data profiling | Databricks | GCP | Google Cloud | Linux | MongoDB | MySQL | NoSQL | Performance Testing | PostgreSQL | PySpark | Python | Redis | Relational databases | SQL | Spark
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Senior-level Full TimeIN-MH-Pune19h ago
-
Senior-level Full TimeIN-TN-Chennai19h ago
-
Senior Software Engineer, Cloud AI/ML Infrastructure INR 2500K-5000KArtificial Intelligence | C++ | CSS | Data Storage | Data StructuresSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Concurrency Control | Database Internals | Distributed Databases | Indexing | MultithreadingEntry-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior Software Engineer, AI/ML Infrastructure INR 2500K-5000KC++ | Data Structures | Data Structures and Algorithms | Distributed Systems | Fine TuningSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Cloud AI Engineer INR 1800K-3000KAlgorithms | Cloud Computing | Cloud platform | Data Pipelines | Data ScienceTravel 30 percentMid-level Full TimeHyderabad, Telangana, India; Pune, Maharashtra, India20h ago
-
Executive-level Full TimeGurgaon, Haryana, India1d ago
-
Principal Applied AI Engineer - Internal Tools INR 400K-700KAI Agents | AI Security | API Integration | API Security | AWS BedrockEntry-level Full TimeBangalore, India1d ago
-
Principal Engineer, Database SQL INR 1500K-2200KADO.NET | Audit Logging | Azure | CI/CD | Data ModelingSenior-level Full TimeRemote, India R1d ago
-
Entry-level Full TimeChennai (ex Madras), IN1d ago
-
Data Engineer INR 1500K-2000KAzure Databricks | Data Quality | Data Warehousing | ETL | Microsoft AzureMid-level Full TimeHyderabad, HDC4A, India1d ago
-
Mid-level Full TimeBhubaneswar, BBDC1A, India1d ago
-
Data Engineer INR 1500K-2000KCloud Platforms | Data Modeling | Data integration | Database Design | DatabricksMid-level Full TimeKolkata, KDC1A, India1d ago
-
DevOps Engineer INR 1500K-2000KAccess Control | Active Directory | Azure Active Directory | Azure AzAPI | Azure DataMid-level Full TimeBhubaneswar, BBDC1A, India1d ago
-
Custom Software Engineer INR 3000K-4000KCloud Computing | Data Warehousing | Data integration | Databricks | ETLSenior-level Full TimeBengaluru, BDC14A, India1d ago
-
Custom Software Engineer INR 720K-1200KCloud Architecture | Data Analysis | Data Compliance | Data Governance | Data integrationMid-level Full TimeBhubaneswar, BBDC1A, India1d ago
-
Generative AI Senior Engineer (Python/Java) – Vice President INR 2000K-3500KAI Governance | AI Safety | API Development | AWS | Agent systemsSenior-level Full TimePLOT NO-1, S.NO. 77, India1d ago
-
Software Engineer III- Python,GenAI,AWS INR 2000K-4000KAI Agents | AWS | AWS Lambda | AWS Step Functions | Amazon AthenaSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Software Engineer II INR 1400K-2500KAI Agents | AWS Lambda | AWS S3 | AWS Step Functions | Amazon AthenaMid-level Full TimeHyderabad, Telangana, India1d ago
-
Senior Machine Learning Engineer INR 2000K-4590KBenchmarking | Data Pipelines | Evaluation | Experimentation | Machine LearningSenior-level Full TimeHybrid in Bangalore, India R1d ago
-
Analytics Engineer INR 3000K-4200KAWS | Airflow | Alteryx | Apache Spark | AzureDiscounted gym memberships | Flexible working | Life assurance | Medical insurance | Pension schemeSenior-level Full TimeHyderabad, Telangana, India1d ago
-
AES - DE - Generative AI Prompt Engineers INR 3000K-4000KAnthropic | Azure OpenAI | CI/CD | Code Analysis | Contract testingSenior-level Full TimePune, Maharashtra, India1d ago
-
Senior-level Full TimeIndia1d ago
-
Software Engineer III-AWS Data Engineer (AI, Data Lake, Snowflake, Python, Spark, Copilot & Claude) INR 2000K-3500KAWS Glue | AWS IAM | AWS Lambda | Amazon Kinesis | Amazon RedshiftSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Cloud Developer INR 1500K-2750KAPI Gateway | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon APISenior-level Full TimeBengaluru, KA, India1d ago