Data Engineer, II
IND - Pune, India
INR 1500K-2750K (estimate) Mid-level Full Time
Tasks
- Automate data pipelines
- Build data pipeline workflows
- Cleanse data
- Conduct performance testing
- Create data validation tests
- Design data pipelines
- Develop PySpark data transformations
- Maintain technical documentation
- Minimize pipeline cost
- Optimize pipeline performance
- Perform code profiling
- Transform data
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Airflow | Apache Airflow | Azure | Dask | Data Validation | Data profiling | Databricks | GCP | Google Cloud | Linux | MongoDB | MySQL | NoSQL | Performance Testing | PostgreSQL | PySpark | Python | Redis | Relational databases | SQL | Spark
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Language: en
Views:
1
Clicks:
0
Saves: 0
Related jobs
-
APIs | Automation | CMDB | CNAPP | CSPMEducation reimbursement | Health plans | Hybrid work | Parental leave | Remote workSenior-level Full TimeRemote - India R6h ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerFlexible asynchronous culture | Friendly relaxed atmosphere | Supportive entrepreneurial team | Work life impactMid-level Full TimeBangalore, India6h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | Dataset EngineeringAsynchronous culture | Flexible remote work | Friendly work environment | Mission-driven workMid-level Full TimeDelhi, India6h ago
-
Senior-level Full TimeBengaluru, India7h ago
-
Procode Developer INR 1500K-2500KAzure | Azure Functions | Azure Logic | Azure Logic Apps | Azure OpenAICareer growth programs | Certification support | Flexible work hours | Remote work | Work-life balanceMid-level Full TimeGurgaon, IN11h ago
-
Senior-level Full TimeBengaluru, KA, IN11h ago
-
Risk Data Engineer INR 2800K-4000KAWS | Automation | Azure | Bitbucket | Cloud platformHealth and wellbeing servicesSenior-level Full TimeBengaluru, IN11h ago
-
Data Engineer INR 3000K-3880KAWS | Batch Processing | Data Cleansing | Data Governance | Data LakeHybrid work environment | Relocation assistance | Remote work options within country | Travel up to 10 percentSenior-level Full TimeIN: Pune - Building 5, India11h ago
-
AI/LLM Platform Engineer INR 2500K-4500KADK | AI gateway | API Design | API Lifecycle Management | API lifecycleSenior-level Full TimeBangalore, KA, IN11h ago
-
Machine Learning Operations Engineer INR 1800K-3000KAlerting | CI/CD | CUDA | Drift Detection | Entity recognitionMid-level Full TimePune, India11h ago
-
Software Development Specialist INR 2800K-4000KAI machine learning | Agile | Apache Spark | Azure CLI | Data EngineeringSenior-level Full TimeBangalore, KA, IN11h ago
-
Senior Data Engineer INR 2500K-3500KAWS | ETL | GCP | Looker | Power BIHybrid work | Professional development | Remote workSenior-level Full TimeDelhi NCR R1d ago
-
Data Engineer (Elasticsearch + Datawarehousing) INR 1500K-2700KAPI | API Development | AWS | Apache Spark | AzureMid-level Full TimeIndia - Remote R1d ago
-
Data Engineer- Service INR 1500K-2500KAWS | Apache Hive | Apache Kafka | Apache NiFi | Apache SparkFlexible working options | Growth opportunities | Health insurance | Professional developmentMid-level Full TimeBangalore1d ago
-
Lead DevOps Engineer INR 2800K-5000KAPI Gateway | AWS | AWS API | AWS API Gateway | AWS CloudFormationSenior-level Full TimeBangalore1d ago
-
L1 Data Engineer - Remote INR 1500K-2400KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative team | Remote workSenior-level Full TimeIndia - Remote R1d ago
-
.NET | Agentic AI | Autonomous Agents | C# | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India1d ago
-
Sr. Software Engineer - Power BI Job INR 3000K-4000KAnalysis Services | Azure DevOps | Azure Synapse | Azure Synapse Analytics | DAXFlexible work arrangements | Inclusive team environment | Stable employment | Training and continuous learningSenior-level Full TimePune, IN1d ago
-
Sr. Software Engineer - Data Bricks Job INR 3000K-4000KARM Templates | Access Control | Algorithms | Analysis Services | Apache SparkContinuous learning | Flexible work arrangements | Inclusive team environment | Stable employmentSenior-level Full TimePune, IN1d ago
-
Module Lead - Data Bricks Job INR 3000K-4000KARM Templates | Access Control | Application Insights | Auditing | Azure CosmosSenior-level Full TimePune, IN1d ago
-
Applied AI and ML Engineer INR 1500K-2500KAgentic Systems | Bias Mitigation | Cloud Platforms | Data analytics | Database queryingMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Applied AI and ML Engineer II INR 1500K-2500KAgentic Systems | Auditability | Deep learning | Drift monitoring | Generative AIMid-level Full TimeBengaluru, Karnataka, India1d ago
-
ARM Cortex | Bolero | Bootloader | CAN | Configuration ManagementSenior-level Full TimeBangalore, IN2d ago
-
Data Engineer INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Gen2Mid-level Full TimeBangalore, Karnataka, IN2d ago
-
Engineeing Manager, Machine Learning INR 1068K-1890KA/B | A/B Testing | Apache Airflow | Apache Spark | B testingCommuter benefits | Financial wellness support | Healthcare dental and vision | Hybrid work schedule | Mental health supportMid-level Full TimeBengaluru, India2d ago