Consultant - Data Engineer
Tasks
- Administer Databricks workspaces
- Administer Redshift Serverless
- Automate infrastructure with CI/CD
- Document and handover operations
- Implement IAM RBAC access controls
- Implement data encryption and key management
- Implement data quality checks
- Maintain GitHub workflows and code reviews
- Manage Unity Catalog governance
- Manage releases and change deployments
- Optimize Redshift query performance
- Orchestrate ETL and ELT pipelines
- Provision Databricks clusters
- Run incident response and root cause analysis
- Set up monitoring and alerting
- Tune PySpark pipelines
- Tune Spark SQL queries
Perks/Benefits
Skills/Tech-stack
AWS CloudTrail | AWS CloudWatch | AWS S3 | Airflow | Amazon EC2 | Bash | CI/CD | Databricks | Delta Lake | ELT | ETL | Encryption | Git | GitHub Actions | IAM | Infrastructure as Code | Jira | Linux | PostgreSQL | PySpark | Python | RBAC | Redshift | Redshift Serverless | SLA monitoring | SLI/SLO | ServiceNow | Spark SQL | Unity Catalog | Unix | “as-code”
Related jobs
-
Solutions Architect INR 2400K-3500KADLS | AWS | Airflow | Azure | CassandraBootcamp training | Broadband reimbursement | Continuous learning opportunities | Medical insurance | Paid certificationsSenior-level Full TimeIndia - Remote R2h ago
-
Sr. SW Engineer, Machine Learning INR 2475K-3465KA/B | A/B Testing | Agent systems | B testing | CI/CDFinancial wellness support | Hybrid work | Mental health support | Time offSenior-level Full TimeBengaluru, India2h ago
-
A/B | A/B Testing | AutoGPT | B testing | Dimensionality ReductionExecutive-level Full TimeMumbai Goregaon, India11h ago
-
Machine Learning Engineer IV INR 4443K-7998KAPIs | Amazon Web Services | Automated testing | Cloud Native | Cloud platformBonuses | Disability insurance | Employee resource groups | Inclusive culture | Life insuranceSenior-level Full TimeRemote, India R13h ago
-
Senior-level Full TimePune City, India17h ago
-
Mid-level Full TimePune, Maharashtra, India17h ago
-
AM - Cloud Data Engineer INR 1500K-2500KAWS N/A | Apache Airflow | Apache Kafka | Apache Spark | Azure DataClient-facing experience | Consulting experience | Growth mindset cultureSenior-level Full TimeBangalore, Karnataka, India17h ago
-
Manager - Risk Analytics Analyst INR 800K-1500KAudit Support | Credit Risk | Credit risk analytics | Data Lakes | Data ModelingAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Inclusive cultureMid-level Full TimeGurugram, India18h ago
-
AI Engineer – Reliability & Warranty Analytics INR 1800K-3000KBacktesting | BigQuery | CI/CD | Calibration | Cloud RunMid-level Full TimeChennai, Tamil Nadu, India18h ago
-
Associate III Business Intelligence-SUPPORT SERVICES-Data & Analytics - In House Engineering INR 800K-1800KBig Data | Big data concepts | C++ | Data Visualization | Data conceptsMid-level Full TimeBangalore, Karnataka, India19h ago
-
AI Engineer – Retail/CPG Domain INR 1800K-2500KAWS | Azure | Data Governance | Data Modeling | Data SecurityMid-level Full TimeGurugram, Haryana, India19h ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4000KAWS | Autogen | Azure | Azure OpenAI | Azure OpenAI ServiceSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Customer Implementation Engineer ( Python | AI/ML) INR 2500K-4500KAWS | Azure | CI/CD | Cause analysis | Cloud platformFlexible-hybrid work | Health insurance | Paid parental leave | Paid time offMid-level Full TimeBengaluru21h ago
-
Associate Principal Engineer (India Office) INR 1500K-2000KADLS | Azure Data | Azure Data Factory | Azure DevOps | CDCMid-level Full TimeBangalore, Karnataka, India21h ago
-
Senior-level Full TimePune, Maharashtra, India21h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India21h ago
-
Applied AI ML Lead INR 2500K-4800KAI Agents | AWS Lambda | AWS S3 | AWS Step Functions | Agentic AISenior-level Full TimeHyderabad, Telangana, India21h ago
-
Software Engineer (Backend Developer) INR 1500K-3500KAWS | Active Directory | Agile | Algorithms | Data StructuresMid-level Full TimeBangalore, India Office (BANGALORE) R21h ago
-
Lead Software Engineer - Java/Python, LLM, AWS INR 3000K-5000KA/B | A/B Testing | AWS | Agile | Amazon AuroraSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Platform Engineering Professional - Data Engineer INR 2200K-3500KAWS | Amazon Kinesis | Apache NiFi | Apache Spark | CI/CDMid-level Full TimeBengaluru, IN, 56010322h ago
-
Senior Data Engineer INR 3000K-4000KAWS Lambda | AWS S3 | AWS SQS | Airflow | AuditingEquity | Health coverage | Paid leaveSenior-level Full TimePune22h ago
-
AWS Data Engineer INR 1500K-6000KAWS | Automation | Cloud Architecture | Data Governance | Data IngestionExecutive-level Full TimeHyderabad, Telangana, India22h ago
-
Mid-level Full TimePune, Maharashtra, India22h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India23h ago
-
Consultant - AI Engineer INR 2000K-4500KAutogen | CI/CD | Cloud infrastructure | CrewAI | Data PipelinesSenior-level Full TimeBangalore, Karnataka, India23h ago