Data Engineer Advisor
Tasks
- Architect Databricks ecosystem across multi workspace environments
- Build pipelines with Delta Live Tables
- Configure cost management with autoscaling and serverless SQL warehouses
- Establish shared data structures
- Implement data ingestion with Auto Loader
- Implement optimized storage using Delta Lake
- Provision data platform components
- Tune Apache Spark for performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Auto Loader | Autopcaling | Azure | Azure DevOps | CI/CD | Cloud platform | Data Skipping | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Git | GitHub Actions | GitLab CI | Google Cloud | Google Cloud Platform | Memory Management | PySpark | Python | SQL | Serverless | Terraform | Unity Catalog | ZORDER
Education
N/A
Roles
Related jobs
-
Senior Software Engineer - Data Platform INR 2500K-3584KAWS | Agentic AI | Apache Airflow | Apache Druid | Apache FlinkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India R18h ago
-
Anthropic Claude | Application Insights | Asynchronous programming | Automated testing | Azure Application InsightsFlexible working environment | Long-term engagement | Mentorship opportunities | Remote workSenior-level Contract Full TimeIndia R1d ago
-
Software Engineer, Data Science INR 1000K-2000KD3 | Data Governance | Data Modeling | Data Pipelines | ETLHealth and wellness programs | Time awayMid-level Full TimeBengaluru, KA, India R1d ago
-
Senior Staff Engineer, Supply chain optimization INR 3000K-4500KAMPL | AWS | Agent-Based Simulation | Agent-based | AnyLogicSenior-level Full TimeRemote, India R1d ago
-
Senior Database Engineer / Senior Consultant Specialist INR 2000K-3200KAccess Control | Backup and Recovery | BigQuery | CI/CD | CassandraSenior-level Full TimePune, Maharashtra, India R1d ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 1860K-3900KAWS | Agent systems | Apache Spark | Apache Spark SQL | AzureSenior-level Full TimeRemote - India R1d ago
-
Senior Staff Engineer, Supply chain optimization INR 3000K-4500KAMPL | AWS | Agent-Based Simulation | Agent-based | AnyLogicSenior-level Full TimeRemote, India R1d ago
-
Senior-level Full TimeHyderabad R1d ago
-
Senior AI/ML Engineer II INR 2475K-4500KContainerization | Data Engineering | DeepSpeed | Distributed Systems | DockerCar lease | Career advancement programs | Certification programs | Continuous learning opportunities | Corporate NPSSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Automation | Azure | Azure Data | Azure Data Explorer | Azure Log AnalyticsCross-functional collaboration | Professional growth | Remote workMid-level Full TimeIndia R1d ago
-
CI/CD | Claude | Code Analysis | Code modernization | Code remediationBusiness resource groups | Career progression | Disability insurance | Employee stock purchase plan | Family leaveSenior-level Full TimeIndia R1d ago
-
API Development | AWS EMR | Amazon EC2 | Amazon IAM | Amazon S3Flexible paid time off | Professional growth opportunities | Remote work from India | Stock grantsSenior-level Full TimeIndia R1d ago
-
AWS | Agile | Azure | Debugging | Deep learningConference access | Financial and legal consultation support | Internal mobility | Language learning resources | Learning and development initiativesSenior-level Full TimeIndia R1d ago
-
Lead Platform Engineer (DevOps) INR 3000K-5000KAWS | Ansible | Azure | Bash | CI/CDCareer growth | Healthcare packages | Hybrid work setting | Mentorship | Online learning platformSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R1d ago
-
Engr III Spec-AI Science INR 2500K-4800KAlgorithm performance | Algorithm performance tuning | Amazon SageMaker | Azure Machine Learning | BentoMLSenior-level Full TimeVDSI, 201 TITUS,. BLDG#10, Hyderabad, IND … R1d ago
-
Dist Engr-AI Science INR 2000K-5000KAgentic AI | CNN | CPU architecture | Data Preprocessing | Deep learningHybrid work | Mentorship | Work from homeSenior-level Full TimeVDSI, 201 TITUS,. BLDG#10, Hyderabad, IND … R1d ago
-
Princ Engr-AI Science INR 2500K-5000KAgentic AI | Data Preprocessing | Deep learning | Distributed Computing | Entity ExtractionHybrid work schedule | Work from homeSenior-level Full TimeVDSI-5th floor Wing B, Etamin Block, … R1d ago
-
Mid-level Full TimeRemote, India R1d ago
-
AVP Senior Data Engineer L11 INR 2771K-4064KAb Initio | Agile | Amazon Redshift | Big Data | Cloud ComputingFlexible working hours | Occasional travel for meetings | Regional engagement hubs | Work from homeSenior-level Full TimeHyderabad IN, India R1d ago
-
AVP, Data Science & AI INR 4000K-5199KAWS | Agentic AI | Agile delivery | Amazon Bedrock | Apache AirflowFlexible working hours | Opportunity for executive exposure | Work from homeExecutive-level Full TimeCentral Region Engagement Hub IN, India R1d ago
-
Principal AI Engineer INR 3407K-5000KAWS | AWS Bedrock | Access Control | Anthropic Claude | AsyncioSenior-level Full TimeHyderabad, India R1d ago
-
Principal AI Engineer INR 3242K-4800KAWS | AWS Bedrock | Access Control | Anthropic Claude | AsyncioSenior-level Full TimeHyderabad, India R1d ago
-
Senior Embedded Software Engineer INR 1800K-3000KAUTOSAR | C# | C++ | Event evaluation | ISO/SAE 21434BusinessBike bicycle leasing | Continuing education programs | Corporate volunteering | Flexible working hours | Health programsSenior-level Full TimePune, MH, IN, 411057 R1d ago
-
Software Engineering LMTS - Tableau INR 3150K-4500KAWS | Agile | Build processes | C# | C++1-on-1 coaching | Adoption Assistance | Fertility benefits | On-demand training | Parental leaveSenior-level Full TimeIndia - Hyderabad R1d ago
-
Site Reliability Engineer - Intermediate INR 2000K-2525KAmazon Web Services | CI/CD | Cloud platform | Datadog | DockerGuided career tracks | Healthcare benefits | Hybrid work environment | Mentorship | Online learning platformMid-level Full TimeIND-Pune-Equifax Analytics-PEC, India R1d ago