Data Engineer
Tasks
- Build data lake pipelines
- Build data warehouse pipelines
- Collaborate with data scientists and ML engineers
- Design ETL pipelines
- Develop PySpark jobs
- Develop Python data processing
- Document code and processes
- Maintain ETL pipelines
- Monitor data pipelines
- Orchestrate workflows with Airflow
- Resolve data quality issues
- Troubleshoot pipeline performance issues
- Write SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Azure | Data Compliance | Data Governance | Data Lakes | Data Processing | Data Security | Data Warehousing | Git | Google Cloud | Langchain | Llamaindex | PostgreSQL | PySpark | Python | Redshift | SQL | Unstructured Data | Unstructured Data Processing | Vector Databases
Education
N/A
Roles
Related jobs
-
(Senior) AI Engineer - Data & AI Organisation (all genders) 1 INR 2500K-5000KAPI Development | Amazon Web Services | Apache Spark | CI/CD | DBTSenior-level Full TimeBangalore, Karnataka, IN, 5601005h ago
-
(Senior) Software Engineer (all genders) 1 INR 3600K-4720KAI Safety | AWS | Amazon Web Services | Apache Spark | Automated testingSenior-level Full TimeBangalore, Karnataka, IN, 5601005h ago
-
AI Engineer (India, China) INR 2500K-4064KAPIs | AWS | Airflow | Apache Spark | AutogenAnnual leave | Flexible working | Life insurance | Medical insurance | Parental leaveMid-level Full TimeBangalore, IN6h ago
-
Mid-level Full TimeIndia - Bengaluru7h ago
-
Adversarial Training | Arize | Audio Processing | Automatic Speech Recognition | Dataset SynthesisChai or coffee | ESOP | Flexible work environment | Free lunch | Workspace perksEntry-level Full TimeNew Delhi, India8h ago
-
AWS S3 | AWS storage | AWS storage services | Active Directory | Ansible100 percent remote work | Flexible time off | Holiday allowance | Medical insurance | Shift allowanceMid-level Full TimeIndia R8h ago
-
Senior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN9h ago
-
Databricks Platform Engineer (AWS) INR 1500K-3500KAWS | AWS Cloud | AWS Cloud Database | Amazon Virtual Private Cloud | Asset bundlesFlexible work arrangement | Hybrid working model | Wellness supportSenior-level Full TimeHyderabad, India R11h ago
-
API Testing | AWS | Azure | BLEU | Bias TestingOnsite workSenior-level Full TimeBengaluru, India11h ago
-
Senior-level Full TimeChennai, Chennai-MRV-AD, IN11h ago
-
Senior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …11h ago
-
Sr Technical Lead-BI INR 1500K-2700KDAX | Data Modeling | Data Warehousing | Dimensional Modeling | ETLSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …11h ago
-
Sr Technical Lead-BI INR 1500K-2700KBI Data modeling | DAX | Data Modeling | Data Warehousing | Dimensional ModelingSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …11h ago
-
Lead Database Engineer INR 3200K-4200KAWS CloudFormation | AWS Performance Insights | Access Control | Always On | Amazon Multi-AZContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - BENGALURU PRIMECO UNION CITY, …16h ago
-
Mid-level Full TimeBengaluru East, Karnataka, India R18h ago
-
Data Engineer - DataOps (Position located in Bengaluru, India) INR 1500K-2500KAI/ML | Analytics | Data Lake | Data Modeling | Data PipelinesAdoption Assistance | Certification completion bonus | Certification reimbursement | Employee referral bonus | Tuition reimbursementSenior-level Full TimeBengaluru, India19h ago
-
Analytics Engineer(Position located in Bengaluru, India) INR 2500K-3380KArtificial Intelligence | DBT | Data Governance | Data Quality | Data TestingAdoption Assistance | Certification completion bonus | Certification reimbursement | Company bonuses | Employee referral bonusSenior-level Full TimeBengaluru, India19h ago
-
Databricks Data Engineer (Databricks, PySpark, Cloud, MLOps) | 100% Remote | Contract 12 + Months | AS A INR 1500K-2600KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | DatabricksRemote workSenior-level Full TimeIndia, India R20h ago
-
Staff Data Engineer INR 1500K-2600KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeBengaluru, KA, India20h ago
-
IT Automation and AI Engineer INR 1200K-2100KAsynchronous Python | CI/CD | Cloud Native | Cloud Native Architecture | Distributed SystemsHybrid work | Onsite onboarding | Professional developmentMid-level Full TimeBengaluru, India21h ago
-
Data Engineer II INR 1000K-1000KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Amazon Web ServicesEmployee assistance program | Hybrid work environment | Learning stipend | Medical coverage | Role-specific trainingMid-level Full TimeMumbai R22h ago
-
Senior-level Full TimeMitratech India22h ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Apache Airflow | Apache Beam | Apache FlinkComplimentary games | Family leave | Health insurance | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India22h ago
-
Senior-level Full TimeHyderabad, India22h ago
-
API Design | Apache Airflow | Apache Beam | Apache Flink | Async messagingContinuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R22h ago