Lead Data Engineer - Data Engineering 4C
1401-GIPL: Prestige Technology Park IV, Bangalore, India
INR 2500K-4000K (estimate) Senior-level Full Time
Tasks
- Administer Databricks workspace users and groups
- Audit AWS account logs
- Configure clusters and jobs
- Configure single sign on and access control
- Deliver client presentations and demos
- Implement infrastructure-as-code
- Lead client stakeholder communications
- Manage Databricks account and workspaces
- Manage S3 access
- Monitor Databricks usage
- Optimize Databricks performance and cost
- Prioritize work on demand
- Set up Databricks security and privacy
- Troubleshoot platform and end user issues
Perks/Benefits
Skills/Tech-stack
AWS | AWS CloudFormation | AWS S3 | Access Control | Apache Spark | Cloud Computing | Databricks | Databricks Clusters | Databricks Jobs | Databricks security | Infrastructure as Code | Single Sign-On | Terraform | Unity Catalog | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Consultant | Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Principal | Principal Consultant
Related jobs
-
Senior Data Engineer INR 2000K-3000KAWS | AWS Batch | AWS Glue | AWS Lambda | AWS Step FunctionsHealth benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India R4h ago
-
Senior-level Full TimeBangalore, KA, IN, 5600766h ago
-
EAI Software Engineer INR 1800K-2500KAPI Gateway | ArgoCD | CI/CD | Cloud Functions | Cloud RunCareer growth | Inclusive work environment | On-site work 4 days a weekMid-level Full TimeHyderabad, India6h ago
-
AI Engineer, FDE (Forward Deployed Engineer) INR 2500K-4200KAWS | Agent systems | Apache Spark | Apache Spark SQL | AzureRemote work | Travel once every 4 to 8 weeksSenior-level Full TimeBengaluru, India; Delhi, India; Mumbai, India; … R6h ago
-
Software Engineer (AI/ML) INR 500KAWS | Attention Mechanisms | Azure | Distributed Computing | Domain AdaptationBirthday day off | Career advancement | Employee assistance program | Gratuity | Group personal accident insuranceMid-level Full TimeBengaluru, Onsite6h ago
-
Senior Data Engineer (Managed Services) INR 1500K-3000KAutomation | Azure | Azure Data | Azure Data Factory | Azure SynapseCareer growth and progression | Company bonus scheme | Comprehensive benefits package | Hybrid work schedule | Inclusive cultureSenior-level Full TimeHyderabad, Telangana, India R9h ago
-
Technical Lead-Data Engg INR 1500K-2700KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - BENGALURU - HP, IN12h ago
-
Azure Databricks Developer INR 1500K-2500KACID | Access Control | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …12h ago
-
Azure Databricks Developer INR 1500K-2500KACID | Access Control | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …12h ago
-
Data Engineer INR 3600K-4720KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | Airbyte401k match | Catered lunches | Comprehensive healthcare | Flexible vacation | HSA contributionsSenior-level Full TimeIndia | Pune18h ago
-
Software Engineer INR 1500K-2000KAgile | Cloud Computing | Code review | Data Modeling | Design PatternsMid-level Full TimePune, India18h ago
-
Senior Big Data Engineer INR 3000K-4000KAlation | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBirthday off | Flexible working hoursSenior-level Full TimeGurgaon19h ago
-
Senior AI Engineer INR 3242K-4680KAI Foundry | AI Search | AI vector search | Agents SDK | Argo WorkflowsAgile working options | Birthday off | Flexible working hoursSenior-level Full TimeGurgaon19h ago
-
AI / ML Data Scientist I INR 750K-1200KAWS | Apache Spark | Artificial Intelligence | Cloud Computing | Cloud platformMid-level Full TimeBengaluru, India19h ago
-
Business Analyst – Automation & AI Solutions (m/f/d) INR 1800K-2134KAWS | Agent workflows | Azure | CI/CD | ClaudeHybrid work model | Language classes | Learning and development | Mentoring program | Travel vouchers and discountsMid-level Full TimeGurugram R21h ago
-
Data Engineer INR 1500K-2500KAWS Cloud | Amazon Web Services | Apache Spark | Databricks | PythonInsurance package | Learning and development resourcesSenior-level Full TimeCoimbatore21h ago
-
Data Engineer with Scala and Spark/ Pyspark INR 2000K-3000KAWS | Agile | Apache Airflow | Apache Spark | AzureHybrid work modeSenior-level Full TimeIndia - Bengaluru; India - Chennai … R22h ago
-
DevOps Engineer (AI Platform) INR 2000K-4800KAccess Control | Application Insights | Azure DevOps | Bicep | Cloud NetworkingSenior-level Full TimePune, Maharashtra, India22h ago
-
ML Developer (with Computer Vision Expertise)- Eurasia INR 2500K-5000KAWS | Adversarial Networks | Algorithms | Azure | Convolutional Neural NetworksSenior-level Full TimePune City, India22h ago
-
Software Developer (AIML) INR 1800K-2700KAWS | Azure | CI/CD | Computer Vision | Convolutional Neural NetworksFlexible working hours | Growth and learning | Referral bonus | Team building events | Training and booksMid-level Full TimePune, India22h ago
-
Architect / POD Lead – Data Engineering INR 1500K-2700KAPI Integration | Avro | Bash Scripting | Batch Processing | Cloud platformSenior-level Full TimeChennai, Tamil Nadu22h ago
-
Data Science - AI ML INR 2500K-5000KAWS | Azure | Bayesian Models | Campaign Optimization | ChatbotsSenior-level Full TimeGurgaon, HR, India23h ago
-
Mid-level Full TimeKarnataka, Bengaluru, India1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
Lead - Data Scientist INR 2500K-4720KAnomaly Detection | Cloud Computing | Data Governance | Deep learning | DevSecOpsCareer development opportunities | Inclusive workplace | Mentoring and team developmentSenior-level Full TimeNoida,Uttar Pradesh,India R1d ago