Data Engineer
Tasks
- Deploy to production
- Design data solutions
- Develop batch data processing
- Develop data pipelines
- Develop streaming data processing
- Document technical artifacts
- Ensure data quality
- Generate and parse JSON
- Generate and parse XML
- Handle REST API requests and responses
- Optimize Spark application performance
- Participate in agile development
- Participate in code release
- Perform ETL processes
- Test data pipelines
- Triage production defects
- Validate business rules
- Write and unit test Spark applications
- Write complex SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Data frame | Hadoop | JSON | NoSQL | OOP | Pair RDD | PySpark | RDD | REST APIs | SQL | Spark SQL | XML
Education
Related jobs
-
Software Engineer III - Bigdata, Spark, AWS - (Data Engineering) INR 3500K-4720KAWS | Agile | Apache Spark | Application Resiliency | Automated testingSenior-level Full TimeHyderabad, Telangana, India6h ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R8h ago
-
Applied AI ML Associate Senior INR 1200K-2500KAI Agents | AWS Lambda | AWS Step Functions | Agentic AI | Amazon AthenaMid-level Full TimeHyderabad, Telangana, India8h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India10h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN15h ago
-
Senior Data Engineer INR 3200K-4200KAWS | Airflow | Apache Spark | CI/CD | Cloud ComputingCompany-matched student loan contribution | Continuous learning resources | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India15h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R15h ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R15h ago
-
Software Development Senior Analyst INR 2000K-4500KAPI Gateway | AWS CloudFormation | AWS Lambda | Agile | Amazon BedrockSenior-level Full TimeChennai, TN, IN15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS Database | AWS Database Migration Service | AWS Glue | AWS Lambda | AWS Step FunctionsFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 2000K-3500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3500KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Apache Airflow | Azure DevOpsSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-2500KAWS | AWS Database | AWS Database Migration Service | AWS Glue | AWS LambdaSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 2000K-3500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India15h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksInclusive benefits | Mentorship programs | Work Life Flexibility ProgramsSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-2500KAWS Database | AWS Database Migration Service | AWS Glue | AWS Lambda | AWS Step FunctionsEqual opportunity workplace | Flexible work programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Apache Airflow | CI/CDSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3500KAWS Glue | AWS Lambda | AWS Step Functions | Apache Airflow | CI/CDFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India15h ago
-
Senior Data Scientist INR 2475K-4500KAgile | Azure | Azure Cognitive | Azure Cognitive Search | Azure DevOpsCollaborative work culture | Hybrid work environment | Inclusive work culture | Learning opportunitiesSenior-level Full TimeJohnson Controls India COEE115h ago
-
Senior Staff Engineer (AI Full-stack Developer) INR 2000K-5000KAWS | Access Controls | Agentic Workflows | Asynchronous programming | Audit LoggingSenior-level Full TimeMumbai, India1d ago
-
Senior-level Full TimeMumbai, MH, India1d ago