Data Engineer
Tasks
- Deploy to production
- Design data solutions
- Develop batch data processing
- Develop data pipelines
- Develop streaming data processing
- Document technical artifacts
- Ensure data quality
- Generate and parse JSON
- Generate and parse XML
- Handle REST API requests and responses
- Optimize Spark application performance
- Participate in agile development
- Participate in code release
- Perform ETL processes
- Test data pipelines
- Triage production defects
- Validate business rules
- Write and unit test Spark applications
- Write complex SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Data frame | Hadoop | JSON | NoSQL | OOP | Pair RDD | PySpark | RDD | REST APIs | SQL | Spark SQL | XML
Education
Related jobs
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India6h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN12h ago
-
Senior Staff Engineer (AI Full-stack Developer) INR 2000K-5000KAWS | Access Controls | Agentic Workflows | Asynchronous programming | Audit LoggingSenior-level Full TimeMumbai, India1d ago
-
Senior-level Full TimeMumbai, MH, India1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Senior-level Full TimePune, India1d ago
-
AI Engineer INR 2000K-4500KAI Foundry | AI Services | API Development | Azure AI | Azure AI FoundryMid-level Full TimeBangalore, IN1d ago
-
Senior Data Engineer - Consulting INR 2500K-4000KAJAX | AWS ECS | Agile | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, Telangana1d ago
-
Data Engineer - Delivery INR 1500K-2000KAmazon Web Services | Azure Blob | Azure Blob Storage | Blob Storage | Data ManagementCollaborative team | Professional growth | Training completionMid-level Full TimeHyderabad, Telangana1d ago
-
Senior-level Full TimeIndia - Bangalore2d ago
-
Staff Software Engineer - Data Platform INR 3000K-4000KAWS | Azure | Bazel | BigQuery | BuildkiteCell phone stipend | Free food | Holidays | In-office collaboration | Medical insuranceSenior-level Full TimeBengaluru, Karnataka, India, APAC2d ago
-
Senior-level Full TimeMumbai, MH, IN, 4000722d ago
-
Lead Data Engineer INR 1500K-2500KApache Airflow | Apache Kafka | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIndia2d ago
-
Senior-level Full TimeHyderabad, IND-TG, India2d ago
-
Planview Administration 169576 INR 1500K-2500KData Governance | Data Modeling | Data Pipelines | Data Validation | ELTSenior-level Full TimeHyderabad, IND-TG, India2d ago
-
Senior-level Full TimeChennai, Tamil Nādu, India2d ago
-
AI / ML Developer / Engineer INR 2000K-3000KAI Agent | AI agent orchestration | Agent Orchestration | Artifact Registry | Backup and Disaster RecoveryMid-level Full TimeIndia2d ago
-
Software Engineer II INR 2771K-4000KAlgorithms | Amazon Web Services | Cloud platform | Data Structures | Distributed SystemsComprehensive health and wellbeing support | Learning and development opportunitiesEntry-level Full TimeGurugram, HR, India2d ago
-
Sr.DataOPS Developer INR 2000K-3000KAWS Greengrass | Airflow | Apache Flink | Apache Kafka | Apache Kafka StreamsSenior-level Full TimeBangalore, India2d ago
-
AI Engineer - India INR 1800K-3000KAzure APIM | Cloud platform | Cypher | Embeddings | FastAPICareer pathing | Flexi benefit plan | Focus time Fridays | Food at work | Group medical coverageMid-level Full TimeChennai R2d ago
-
Data Scientist INR 3000K-5000KAWS | Airflow | Amazon SageMaker | Apache Spark | Azure Machine LearningSenior-level Full TimeIN-MH-Pune2d ago
-
Senior Applied AI/ML Engineer INR 3500K-5000KAgentic Systems | Autonomous Agents | Bias Mitigation | Data Analysis | Deep learningSenior-level Full TimeBengaluru, Karnataka, India3d ago
-
Mid-level Full TimeHyderabad, India3d ago
-
Senior-level Full TimeBangalore, Karnataka, India3d ago
-
Database Engineering Associate - Snowflake Developer INR 1500K-2000KAPI Integration | AWS | Access Management | Agile | Batch ProcessingFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R3d ago