Data Engineer _ ALM - MTCR
Tasks
- Administer Cloudera CDP CDH platforms
- Build and maintain CI/CD pipelines
- Create pipelines with Jenkins
- Develop PySpark and Python data processing
- Ensure high availability
- Implement access management and governance
- Implement security and code quality checks
- Integrate GitHub Bitbucket
- Monitor platform health
- Optimize HDFS Hive Spark YARN Hue CDE
- Perform upgrades and troubleshooting
- Write and optimize Hive and Impala SQL queries
Perks/Benefits
Skills/Tech-stack
Apache Hive | Apache Spark | Apache YARN | Bitbucket | CDE | CI/CD | Checkmarx | Cloudera | Cloudera CDH | Cloudera CDP | GitHub | HDFS | Hue | Jenkins | Linux | Performance Tuning | PySpark | Python | SAST | SQL | SQL Performance | SQL Performance Tuning | Shell Scripting
Education
N/A
Roles
Related jobs
-
Continuous integration | Development Lifecycle | Git | JavaScript | LaravelCo-working space | Mentorship | Modern equipment | Training programs | Trial dayMid-level Full TimeChennai, Hybrid R22h ago
-
Principal Data Engineer Data Technology INR 3000K-4000KAPIs | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimePune, Maharashtra, India R23h ago
-
Senior Machine Learning Engineer INR 3584K-4800KAWS | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Development programs | Learning and development programs | Remote work flexibility | Work from office or client siteSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer INR 3584K-4800KAWS | Azure | CI/CD | Databricks | Distributed SystemsCareer Development Programs | Learning and development programs | Mentoring and coaching | Remote work flexibilitySenior-level Full TimeBangalore, India R1d ago
-
Java Big Data Developer - Experienced INR 1500K-3000KApache Hadoop | Apache Kafka | Apache Spark | Design Patterns | DockerSenior-level Full TimePune, IN R1d ago
-
Staff Software Engineer - India INR 4000K-5000KAPI Development | AWS | Agentic AI | Azure | Cloud infrastructureCareer growth | High visibility and impact | Open Source contributionSenior-level Full TimeBengaluru R1d ago
-
Mid-level Full TimePune, Maharashtra, India R1d ago
-
Java Big Data Developer - Senior INR 1200K-3000KApache Hadoop | Apache Kafka | Apache Spark | Design Patterns | DockerSenior-level Full TimePune, IN R1d ago
-
Apache Spark | Artificial Intelligence | Docker | Generative AI | KubernetesCareer development opportunities | Employee resource groups | Inclusive Workplace Programs | Paid time off | Paid volunteer timeSenior-level Full TimeIndia R1d ago
-
AI/ML Engineer INR 1500K-2500KAI Platform | AWS SageMaker | Airflow | Azure Machine Learning | CI/CDMid-level Full Time Part TimeIndia - Remote R1d ago
-
ASR | AWS | Audio Processing | Cloud platform | ContainerizationFlexible working hours | Fully remote | Mentorship | Professional growthSenior-level Full TimeIndia R1d ago
-
Technical Lead (.Net) - (India) INR 2500K-4500K.NET | API Development | AWS | Agile | Automated testingSenior-level Full TimeVirtual - India R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Azure Data | Azure Data Factory | Azure OpenAI | CI/CD | DAXHybrid scheduleSenior-level Full TimeIND-Pune-Smartworks, India R1d ago
-
Senior Data Engineer INR 3000K-4200KAPI Development | AWS | Automated testing | Data Modeling | Database DesignEquipment provided | High autonomy | Medical coverage | Paid annual leave | Public holidaysSenior-level Full TimeIndia, India - Remote R1d ago
-
Data Solutions Engineer INR 3380K-4580KAPI Development | Access Control | CI/CD | Cloud Platforms | Data GovernanceSenior-level Full TimeBangalore, India R1d ago
-
Sr Consultant- AI & Automation INR 3000K-5500KAWS | Azure | CI/CD | Computer Vision | Data AnalysisSenior-level Full TimeRemote, India R1d ago
-
Senior Data Engineer - Career INR 1500K-2500KCI/CD | Cloud platform | Data Governance | Data Modeling | Data PipelinesHealthcare packages | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R1d ago
-
Data Scientist - Specialist INR 3600K-5400KAgentic AI | Amazon Web Services | Apache Spark | Azure | Big DataCareer growth | Healthcare package | Hybrid work | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R1d ago
-
Site Reliability Engineer-Career INR 3000K-4720KAWS | Ansible | Bash | Blameless postmortems | CI/CDGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Organizational growth potentialSenior-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India R1d ago
-
Specialist, Customer Analytics INR 650K-700KAWS | Azure | Azure OpenAI | Chroma | Cortex AIAccident and life insurance | Annual leave | Business travel insurance | Cab facility | Gratuity paymentMid-level Full TimePune - Business Bay, India R1d ago
-
Data Analytics Senior Integration Data Engineer INR 2400K-3465KAPIs | AWS Glue | AWS S3 | AWS Snowpipe | Azure DataHybrid work environment | No TravelSenior-level Full TimeIN, Bangalore Kar, India R1d ago
-
Senior Data Engineer INR 3000K-4200KApache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryCertification opportunities | Coaching | Hybrid work flexibility | Professional development | Wellbeing programsSenior-level Full TimeIN152015 NOIDA (IN152015) ARTHA INFRATE, India R1d ago
-
Data Engineer II INR 1000K-1820KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure FunctionsMid-level Full TimeIND-Hyderabad-Hybrid, India R1d ago
-
Senior-level Full TimeBangalore, KA, IN R1d ago