Data Engineer
Tasks
- Assemble large, complex data sets
- Build data extraction, transformation, and loading pipelines
- Coordinate team adherence to local processes and policy
- Create and maintain data pipeline architecture
- Develop analytics tools and production ready models
- Develop reusable business intelligence reports
- Document source-to-target mappings
- Implement data flows between operational systems and analytics
- Implement data pipeline process improvements
- Provide day to day supervision of data science and engineering team
- Re engineer manual data flows for scaling
- Support data-related technical issues for stakeholders
- Write ETL scripts and code
Perks/Benefits
Skills/Tech-stack
API Development | AWS | Amazon Redshift | Azure | Bash | C++ | Dask | Data Lake | Data Warehousing | Databricks | ETL | GCP | Go | Kafka | Kotlin | Linux | Microsoft SQL | Microsoft SQL Server | MySQL | NumPy | Pandas | PostgreSQL | PySpark | Python | SQL | SQL Server | Scala | Snowflake | Stream processing
Education
Roles
Data Engineer | Engineer | Engineering | Engineering Manager | Manager
Related jobs
-
Staff Software Engineer, Cloud SQL Postgres INR 1500K-2400KC++ | Database Administration | PostgreSQL | Query Optimization | Relational databasesSenior-level Full TimeBengaluru, Karnataka, India1h ago
-
Consultant - Gen AI Engineer INR 550K-610KAPI Integration | Generative AI | Language Processing | Machine Learning | Natural LanguageEntry-level Full TimeBangalore, Karnataka, India5h ago
-
Manager INR 1000K-1400KData Engineering | Data Quality | Data Sanity | Data Sanity Checking | Data TestingMid-level Full TimeGurugram, Haryana, India5h ago
-
Gen AI Lead engineer INR 3000K-4800KAgentic Frameworks | CI/CD | Data Visualization | Git | LangchainSenior-level Full TimeChennai, Tamil Nadu, India5h ago
-
Full Stack Developer :: Acon INR 2500K-3500KAI Search | AI Studio | Application Security | Arize Phoenix | Azure AISenior-level Full TimeIndia6h ago
-
Lead Assistant Manager INR 2500K-4500KASR | AWS EC2 | Amazon ECS | Amazon SageMaker | Amazon Web ServicesSenior-level Full TimeNoida, Uttar Pradesh, India6h ago
-
Engineering Manager - Batch Compute Infrastructure INR 1800K-2525KAWS | AWS Cloud | Amazon S3 | Apache Airflow | Apache KafkaMid-level Full TimeBengaluru7h ago
-
Data Engineer- AWS+MS Fabric+ Purview INR 2000K-3500K.NET | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSSenior-level Full TimePune, Maharashtra, India8h ago
-
Mid-level Full TimeBangalore, India12h ago
-
Senior-level Full TimeBangalore, India12h ago
-
Assistang Manager INR 1000K-1400KAPIs | Data Catalog | Data Cleansing | Data Deduplication | Data EnrichmentMid-level Full TimeBangalore North, India12h ago
-
Mid-level Full TimeBangalore, India12h ago
-
Technical Fulfillment Specilaist INR 1500K-2400KAWS | Agile | Apache Airflow | Batch Processing | BigQueryGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India13h ago
-
Technical Fulfillment Specilaist INR 1500K-2400KAWS | Atlassian Confluence | Atlassian Jira | Batch Processing | BigQueryGuided career tracks | Healthcare packages | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India13h ago
-
Site Reliability Engineer INR 1170K-1500KAlerting | Ansible | Bash | CI/CD | ChefCareer growth | Healthcare benefits | Hybrid work setting | Online learning platform | Paid time offEntry-level Full TimeIND-Pune-Equifax Analytics-PEC, India13h ago
-
Site Reliability Engineer - Intermediate INR 1800K-2345KAlerting | Ansible | Bash | Chef | Cloud CLIHealthcare | Hybrid work setting | Online learning platform | Paid time offMid-level Full TimeIND-Pune-Equifax Analytics-PEC, India13h ago
-
Archiving Squad Data Engineer-Staff INR 2520K-3880KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130113h ago
-
APIs | CI/CD | Data Pipelines | Data Processing | MLOpsCareer development | Hybrid workSenior-level Full TimeHyderabad, IN, 50003213h ago
-
Archiving Squad Data Engineer-Senior INR 2520K-3880KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130113h ago
-
Archiving Squad Data Engineer-Senior INR 2520K-3880KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130113h ago
-
Senior Lead - Data Engineer (Adobe Analytics) INR 1800K-2600KAEP Data Collection | AEP schemas | Adobe Analytics | Adobe Experience | Adobe Experience PlatformSenior-level Full TimeMumbai Central Avenue, India13h ago
-
Mid-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India13h ago
-
Mid-level Full TimeGCC, India13h ago
-
Abinitio | Autosys | Cloud platform | Code review | Data WarehouseAgile environment | Code review responsibilitySenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India13h ago
-
Agentic AI | Artificial Intelligence | Data Analysis | Data Engineering | DatabricksCareer development | Inclusive workplace | Training opportunities | Wellbeing supportSenior-level Full TimeNew Delhi, National Capital Territory, IN, …13h ago