Data Engineer
Tasks
- Automate workflow orchestration and monitoring
- Collaborate with cross-functional teams
- Design and build data solutions
- Develop and maintain data pipelines
- Ensure data quality
- Implement ETL and ELT processes
- Implement data security and privacy
- Ingest and transform large scale datasets
- Integrate multiple data sources
- Model data and maintain data dictionaries
- Optimize big data processing performance
- Resolve data-related challenges
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | AWS | Apache Airflow | Apache Spark | CCPA | Caching | Cloud Storage | Data Governance | Data Modeling | Data Privacy | Data Security | Data Warehousing | Data integration | Databricks | Databricks Jobs | ELT | ETL | GDPR | Indexing | Job tuning | Partitioning | PySpark | Python | SQL | Spark Job Tuning | SparkSQL | Workflow Orchestration
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | Batch Processing | C++ | Cloud platform | DNSSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India2h ago
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | C++ | DMZ | DNS | Data LakeEqual opportunity work environment | Travel as requiredSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India2h ago
-
Assistant Manager- AI Engineer with Cloude INR 2000K-3000KAWS | Autogen | Azure | Claude | Cloud platformLeadership opportunity | MentorshipMid-level Full TimeBangalore, Karnataka, India3h ago
-
AWS Data Engineer- Assistant Manager INR 1200K-2000KAWS Data | AWS Data Pipeline | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeBangalore, Karnataka, India3h ago
-
Data Engineering Professional INR 2000K-2146KAgile methodologies | Artificial Intelligence | Cloud Computing | Data Engineering | Data ManagementSenior-level Full TimeBengaluru, IN, 5601034h ago
-
Data Engineer INR 938K-1200KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India5h ago
-
Software Engineer + Gen AI (Fresher) INR 300K-540KAI Model Integration | AI model | API Integration | Algorithms | Data StructuresEntry-level Full TimePune, MH, India6h ago
-
Applied AI ML Associate Senior INR 1050K-1250KAWS | Big Data | CI/CD | Continuous Delivery | Continuous integrationMid-level Full TimeHyderabad, Telangana, India7h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India7h ago
-
Data Engineer III Mainframe DB2/IMS DBA INR 2486K-4144KAtlassian Confluence | Atlassian Jira | BMC Recovery Manager | Backup and Recovery | CA Platinum24x7 rotational supportSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Software Engineer III - Data Engineer INR 1500K-2146KAWS | Apache Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
IN-Associate_AI/ML Developer_MS Engg_Advisory_Kolkata INR 1500K-2000KApp Service | Azure App | Azure App Service | Azure Blob | Azure Blob StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India13h ago
-
CI/CD | Couchbase | Design Patterns | Docker | GuiceSenior-level Full TimeGurugram 8 B, India13h ago
-
Sr. Azure Data Engineer INR 1500K-2000KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - BENGALURU - HP, IN13h ago
-
IN-Associate 2_Azure Data Engineer_OC D&A_Advisory_Bhubaneswar INR 1500K-2000KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBhubaneswar - Ihub, India13h ago
-
Mid-level Full TimeBangalore, KA, IN, 56214913h ago
-
Mid-level Full TimeIndia - Hyderabad13h ago
-
Senior-level Full TimeIndia - Hyderabad13h ago
-
Mid-level Full TimeIndia - Hyderabad13h ago
-
Mid-level Full TimeIndia - Hyderabad13h ago
-
Senior-level Full TimeIndia - Hyderabad13h ago
-
Senior Engineer Data - MDM INR 1628K-2146KAgile | Amazon Web Services | Azure | Cloud Platforms | Cloud platformFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India13h ago
-
Lead Engineer Data - MDM INR 1500K-2040KAPIs | Agile | Amazon Web Services | Azure | Cloud platformFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India13h ago
-
Data and AI Engineer INR 2520K-3380KArtificial Intelligence | Data Architecture | Data integration | Database | Digital PlatformHybrid work flexibilitySenior-level Full TimeBangalore–Embassy Business Hub, India13h ago
-
Lead Engineer Data INR 2156K-2400KAgile methodology | Automation | Azure | Azure Data | Azure Data FactoryFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India13h ago