IBM Datastage, Pyspark, Control-M/Consultant Specialist
Hyderabad, Telangana, India
R
INR 800K-2000K (estimate) Mid-level Full Time
Tasks
- Build and maintain ETL workflows
- Collaborate with data stakeholders
- Conduct production issue investigation and root cause analysis
- Create technical documentation for data mappings and runbooks
- Design ETL data pipelines
- Develop batch scheduling with Control-M
- Ensure data quality auditability and data lineage
- Implement stability and resilience fixes
- Monitor and automate workloads
- Optimize PySpark data processing
- Perform Linux automation and troubleshooting
Perks/Benefits
Skills/Tech-stack
Apache Spark | Control-M | ETL | IBM DataStage | Linux | PySpark | Python | Shell Scripting | Unix
Education
N/A
Roles
Related jobs
-
Senior AI/ML Engineer I INR 2000K-3465KAI Search | Asynchronous programming | Azure | Azure AI | Azure AI SearchCareer growth opportunities | Certification programs | Education reimbursement programs | Employee assistance program | Employee stock purchase planSenior-level Full TimeBangalore, Karnataka, India R7h ago
-
Senior Technical Anchor INR 4000K-5500KApache Spark | Batch Processing | BigQuery | CI/CD | Cloud BuildSenior-level Full TimeChennai, Tamil Nadu, India R10h ago
-
Senior DevOps Consultant INR 3000K-4500KAKS | API Management | Application Insights | Azure | Azure ContainerCareer coaching | Employee assistance programme | Flexible working hours | Hybrid work | TrainingSenior-level Full TimeBengaluru, Karnataka, India R13h ago
-
Senior Manager INR 1500K-3000KAWS Secrets | AWS Secrets Manager | Adaptive Query | Adaptive query execution | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India R13h ago
-
AI Agents | AWS | Anthropic | Azure | Azure OpenAIDirect customer collaboration | Freelance contract opportunity | Fully remote | Inclusive workplace | Learning opportunitiesMid-level Full TimeIndia R14h ago
-
Data Engineer INR 1500K-2700KAsset bundles | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Flexible workplace accommodations | Hybrid work modelMid-level Full TimeChennai, India R14h ago
-
AWS Bedrock | Amazon SageMaker | BentoML | CI/CD | DockerCollaborative environment | Exposure to modern AI ML infrastructure | Full-time employment | Remote work from India | Technical ownershipSenior-level Full TimeIndia R18h ago
-
Sr Data Engineer - ETRM INR 2771K-4064KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible working hours | Paid parental leave | Remote working option | Training and development programmesSenior-level Full TimeBangalore RMZ-ECO WORLD, India R19h ago
-
Data Scientist Engineer Advisor INR 2400K-3380KAWS | Azure | Bias Mitigation | Data Analysis | Data QualityMid-level Full TimeBangalore, KA, IN R19h ago
-
Senior Computer Scientist 1 INR 3000K-4680KCI/CD | Cloud Platforms | Docker | Generative AI | Integration AutomationSenior-level Full TimeNoida, India R19h ago
-
Data Science Engineer INR 2775K-4500KA/B | A/B Testing | Anomaly Detection | B testing | ClusteringEntry-level Full TimeBangalore, India R19h ago
-
Senior Software Engineer INR 3264K-5000KAgile | Azure | CI/CD | Cloud Computing | Computer VisionAccess to Headspace app | Flexible work-life balance | Hybrid work model | Mental health days | Paid volunteer daysSenior-level Full TimeIndia, Bengaluru, Karnataka R19h ago
-
Senior Analyst Automation INR 3242K-5000KAPI Gateway | AWS | Amazon Bedrock | CI/CD | Generative AIFlexible work environment | Internal mobility | Volunteer opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Remote, India R19h ago
-
GenAI Developer / Engineer (Senior / Lead) INR 2000K-5000KAPIs | AWS | Agent systems | Agentic AI | Anthropic APISenior-level Full TimeRemote Karnataka, India R19h ago
-
Lead - Data Engineering INR 3000K-4200KCI/CD | DB2 | Data Mining | ETL | ElasticsearchAccess to learning opportunities | Coaching | Continuous feedback | Hands-on learning opportunities | Hybrid work environmentSenior-level Full TimeKIN51515 Mumbai (KIN51515) We Work, India R19h ago
-
VP - Senior Data Engineer INR 4000K-4000KAWS | Airflow | Azure | Cloud Platforms | DBTComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Tuition reimbursementExecutive-level Full TimeBL4 - KNG Tower 1, Indiqube … R19h ago
-
AI Engineer INR 3672K-4800KAPI Integration | Access Controls | Agent Orchestration | CI/CD | Data Leakage PreventionAsynchronous work | Career growth | Continuous learning | Remote workMid-level Full TimeRemote, Bangalore R21h ago
-
Senior Data Platform Engineer INR 3584K-4580KAWS | Apache Kafka | Apache Spark | Azure | Cloud platformCollaborative cross site work | Healthcare benefits | Internet or cell phone reimbursement | Learning and development stipend | Travel opportunities to headquartersSenior-level Full TimeBengaluru, India R22h ago
-
Senior Software Engineer - Multi-Product Platform INR 2500K-4680KAPI Development | Error Handling | Fault Tolerance | Incident Response | MonitoringSenior-level Full TimeHybrid - Bangalore, India R1d ago
-
BigQuery | CI/CD | Cloud Composer | Cloud IAM | Cloud NetworkingConference reimbursement | Corporate discounts | Coworking reimbursement | Equipment and workspace reimbursement | Fully remoteSenior-level Full TimeIndia R1d ago
-
Senior AI Engineer/ Senior Associate Director, Tech SME INR 1860K-2800KAPIs | AWS | Agent Orchestration | Agent systems | AzureMid-level Full TimePune, Maharashtra, India R1d ago
-
AI Agent | AI Services | AI agent orchestration | API Integration | Agent OrchestrationContract opportunity | Enterprise AI exposure | Hands-on cloud and automation experience | Remote work flexibilityMid-level Contract Full TimeIndia R1d ago
-
CD pipelines | CI/CD | CI/CD pipelines | Docker | FlaskMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Data Engineer INR 720K-720KAWS | Apache Airflow | Apache NiFi | Apache Superset | AzureChildcare support | Counseling sessions | Health insurance | Internet allowance | Learning SupportSenior-level Full TimeBangalore, India R1d ago
-
AWS Lambda | Amazon DynamoDB | Amazon RDS | Amazon S3 | CI/CDHybrid workSenior-level ContractHyderabad, India R1d ago