EY-GDS Consulting-AI And DATA-Databricks-Manager
Trivandrum, KL, IN, 695581
USD 142K-242K (estimate) Mid-level Full Time
Tasks
- Build data ingestion workflows from multiple sources
- Collaborate with cross functional teams to deliver project workstreams
- Design and deploy ETL and ELT pipelines
- Develop and deploy Databricks in cloud
- Implement data streaming pipelines
- Implement data transformations
- Manage project timelines and deliverables
- Optimize SQL queries and Spark jobs for scalability
- Optimize model code for execution performance
- Support analysis design development testing production deployment and operations
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CD | Data Factory | Data Lake Storage | Data Streaming | Data pipeline | Data pipeline orchestration | Databricks | Delta Lake | DevOps | ELT | ETL | Lakehouse | Performance Tuning | Pipeline Orchestration | Procedural SQL | PySpark | Python | SQL | SQL Performance | SQL Performance Tuning | SQL Server | Unity Catalog
Education
N/A
Roles
Related jobs
-
Featured Feat. Software Engineer USD 40K-150K.NET | APIs | AWS | Angular | AzureContractor hours flexibility | Remote workMid-level ContractRemote R10d ago
-
Featured Feat. Senior Software Engineer USD 80K-170KAlgorithms | C++ | Data Structures | Go | JavaContractor flexibility | Remote workSenior-level ContractRemote R10d ago
-
Senior Applied AI Engineer AUD 119K-161KAgent Orchestration | Agent systems | Bias Testing | Context engineering | Evaluation datasetsCoaching | Equity | Extended end of year break | Home workspace setup budget | Inclusive parental leaveSenior-level Full TimeMelbourne8h ago
-
Automotive Ethernet | Bootloader | C# | C++ | CANAnnual leave | English-speaking environment | Family health coverage | Fitness and sport activities | Flexible working timeMid-level Full TimeHo Chi Minh, Vietnam8h ago
-
Software Engineer, Data (L1) USD 75K-130KAI Platform | APIs | Apache Airflow | Apache Iceberg | Apache Spark401k match | Calm subscription | Career growth and learning opportunities | Commuter benefits options | Dental insuranceMid-level Full TimeAustin, TX8h ago
-
AWS | Adversarial Machine Learning | Amazon SageMaker | Anonymization | AzureCutting-edge AI security work | Flexible working hours | Fully remote | Global cross-functional collaboration | Opportunity to shape AI security best practicesSenior-level Full TimeIndia R8h ago
-
A/B | A/B Testing | AWS | Azure | B testingFlexible working hours | Flextime policy | Hybrid work model | International collaboration | Technical growth opportunitiesSenior-level Full TimeIndia8h ago
-
Senior Software Engineer, Machine Learning INR 2500K-3500KA/B | A/B Testing | Amazon S3 | Apache Airflow | Apache SparkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India8h ago
-
Staff Machine Learning Engineer - Recommendations AUD 119K-136KData-Driven Decision Making | Data-driven | Decision Making | Machine Learning | Model EvaluationEquity packages | Flexible leave options | Parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia9h ago
-
Solutions Engineer – Robotics & Autonomous Driving USD 152K-500K2D Imaging | 3D Imaging | Autonomous Driving | C++ | CameraCommuter stipend | Generous PTO | Global travel | Health, dental, vision coverage | Learning and development stipendSenior-level Full TimeSan Francisco, CA; New York, NY10h ago
-
Data Engineer II USD 120K-174KAWS | AWS Glue | Agile | Amazon EMR | Amazon RedshiftCollaborative events | Continuous learning | Health and wellness benefits | International exposure | MacBook providedMid-level Full TimeHo Chi Minh R10h ago
-
Data pipeline | Debugging | Inference Optimization | Java | KubernetesFlexible leave options | Flexible work hours | Inclusive parental leave | Office setup allowance | Remote friendly within AustraliaSenior-level Full TimeSydney, Australia11h ago
-
AI Developer and Data Lead USD 91K-184K.NET | AI Security | API Development | AWS Lambda | Amazon AuroraSenior-level Full TimeWashington, DC11h ago
-
Machine Learning Research Engineer USD 161K-189KAWS | Azure | Bias Variance | Bias-Variance Tradeoff | C++Flexible hybrid work model | Mental health counseling | Mentorship programs | Paid parental leave | Paid volunteer time offMid-level Full TimeNew York, US, New York12h ago
-
Manager Software Engineer- ML + NLP+ ppl management INR 3200K-4800KAPIs | BERT | Data Mining | Data Science | Deep learningFlexible work arrangements | Hybrid work environmentSenior-level Full TimeGurgaon - Cyber Park, India12h ago
-
Principal Engineer, Storage Data Science and Analytics INR 3200K-4590KAIOps | Anomaly Detection | Apache Spark | C# | C++Career Development Programs | Flexible work arrangements | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India12h ago
-
Principal Engineer, Storage Data Science and Analytics INR 3000K-3900KAIOps | Agentic Workflows | Anomaly Detection | C# | C++Senior-level Full TimeBengaluru, Karnātaka, India12h ago
-
Data Scientist (Mirage/Data Practice/AI) SGD 132K-204K3D Geometry | AWS | CGAL | CI/CD | Differential PrivacyCoaching | Employee referral support | Hybrid work environment | Learning opportunities | Well-being programsEntry-level Full TimeKSG51588 Singapore (KSG51588)12h ago
-
Senior-level Full TimeBengaluru Office, India12h ago
-
AI Core | AI Platform | Databricks | Python | SAP AIEntry-level InternshipPlattling, BY, DE, 9444712h ago
-
Clustering | Data Lake | Data Modeling | Data Transformation | Data VisualizationKnowledge transfer sessions | Training and consultancyExecutive-level Full TimeITE-HQ (Headquarters), Singapore12h ago
-
Senior-level Full TimeBangalore, India R12h ago
-
Big Data | Cloud Cost Optimization | Cost Optimization | Data Governance | Data Security401k plan | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSpringdale, AR Terminal Office - Springdale, …12h ago
-
Senior Data Engineer - Logistics USD 38K-38KBig Data | Cloud Cost Optimization | Column-Level Security | Cost Optimization | Data Governance401k plan | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeSpringdale, AR Terminal Office - Springdale, …12h ago
-
Data Engineer – Data Science & Technology GBP 38K-50KData Architecture | Dimensional Modeling | ELT | ETL | NumPyAccess to fitness facilities | Charitable contribution match | Charity volunteer days | Continued learning opportunities | Employee assistance programsMid-level Full TimeLondon, United Kingdom12h ago