Data Engineer PK (Python/PySpark/AWS Glue/Amazon Athena/SQL/Apache Airflow)
Tasks
- Build optimize and scale data pipelines
- Build reusable frameworks and connectors for data publishing
- Design and operationalize ingest and transformation workflows
- Integrate pipeline health metrics into dashboards
- Model and implement scalable data transformations
- Monitor and alert on pipeline execution
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Alerting | Amazon Athena | Apache Airflow | Cost Optimization | DAG | Data Lineage | Data Modeling | Data Observability | Data Pipeline Monitoring | Data Quality | Data pipeline | ETL | Logging | Metrics | Pipeline monitoring | PostgreSQL | PySpark | Python | Retries | SLAs | SQL | Snowflake | Tracing | TypeScript
Education
N/A
Roles
Related jobs
-
Senior Data Engineer - Full Stack (US, Remote) INR 2000K-3000KAPI | AWS | CI/CD | CLI | Data GovernanceCollaborative team | Developer productivity focus | Remote workSenior-level Full TimeMaharashtra, Pune, India R3h ago
-
Finance BI & Data Engineer - 12 month FTC AUD 120K-130KAnomaly Detection | Artificial Intelligence | Data Architecture | Data Governance | Data ModelingHealth care support | Learning and development opportunities | Paid leaveMid-level Contract TemporaryAustralia (Remote) R13h ago
-
Senior Design Engineer, Embedded Agreements PLN 372K-480KAI integration | API Design | Accessibility | CSS | DocumentationCollaborative supportive team | Hybrid work option | Professional development | Remote work | Work schedule aligned with EU time zonesSenior-level Full TimeRemote (Europe) R13h ago
-
Senior Design Engineer, Embedded Agreements PLN 372K-480KAPI Design | Accessibility | CSS | Figma | PerformanceCollaborative team | EU time zone schedule | Professional development | Remote-first | Work schedule aligned with EU time zonesSenior-level Full TimeRemote (Poland) R13h ago
-
Senior Design Engineer, Embedded Agreements PLN 372K-480KAPI Design | CSS | Claude Code | Cursor | FigmaCollaborative supportive team | EU time zone aligned work schedule | Professional development | Remote-firstSenior-level Full TimeRemote (Portugal) R13h ago
-
Senior Design Engineer, Embedded Agreements PLN 372K-480KAPI Design | Accessibility | CSS | Claude Code | CursorEU time zone schedule | Professional development | Remote-first | Supportive team | Work-life balanceSenior-level Full TimeRemote (Ukraine) R13h ago
-
Staff Data Engineer USD 160K-207KAnomaly Detection | Business Intelligence | DBT | Data Architecture | Data Engineering401k match | Dental insurance | Family planning resources | Flexible vacation days | Learning and development programSenior-level Full TimeRemote - USA R13h ago
-
API Integration | API Security | Authentication | CI/CD | Cloud NetworkingAnnual performance bonus | Career growth | Fully remote workSenior-level Full TimeCanada R15h ago
-
AI Engineer, (Full Stack Development) INR 1800K-3000KAPI Integration | AWS | Anthropic | Authentication | Cloud FunctionsMid-level Full TimeMumbai, Maharashtra, India - Remote R16h ago
-
Sr. Analytics Engineer - Data Warehouse (Hybrid, Bangalore) INR 2515K-3500KAWS | Airflow | Amazon EC2 | Amazon S3 | AmplitudeCareer growth opportunities | Hybrid work | MentorshipSenior-level Full TimeBangalore, INDIA R18h ago
-
AI Research Engineer (Multi-Modal & Vision) USD 100K-150KBenchmarking | Computer Vision | Dataset curation | Distributed Training | Efficient Fine TuningRemote workSenior-level Full TimeRemote job R18h ago
-
AI Research Engineer (Multi-Modal & Vision) USD 100K-150KData Curation | Dataset Filtering | Distributed Training | Efficient Fine Tuning | Evaluation benchmarksRemote workSenior-level Full TimeRemote job R18h ago
-
Marketing Analytics Engineer USD 142K-196KA/B | A/B Testing | Amazon Redshift | Attribution | B testingEntry-level Full TimeLehi, UT R18h ago
-
Senior Lead, Support INR 2000K-4800KAI Foundry | Amazon Bedrock | Anthropic Claude | Authentication | AuthorizationSenior-level Full TimeRemote Working, India R19h ago
-
Senior Software Engineer (AI Data Engineering) USD 180K-210KAgentic Workflows | Architecture alignment | Backend Development | Code review | Data Modeling401k matching | Catered lunches | Dental insurance | Flexible schedule | Medical insuranceSenior-level Full TimeNew York, NY or Remote R19h ago
-
Senior Data Engineer CAD 100K-120KAdobe Analytics | Adobe Experience | Adobe Experience Cloud | Adobe Journey Optimizer | Adobe LaunchRemote workSenior-level Full TimeCanada R20h ago
-
Freelance Senior Data Engineer USD 100K-120KAdobe Analytics | Adobe Customer Journey | Adobe Customer Journey Analytics | Adobe Journey Optimizer | Adobe LaunchEquipment provided by worker | Freelance contract | Remote workSenior-level FreelanceUnited States R20h ago
-
3D Computer Vision | 3D Reconstruction | AWS | Aerial Imagery | AzureCareer Growth & Development | Drone certification | Employee referral bonus | Flexible paid time off | Healthcare coverageSenior-level Full TimeRemote R20h ago
-
AWS | Agentic AI | CI/CD | Cloud Architecture | Data IngestionCloud partnership resources | Professional development trainingSenior-level Full TimeBogota, Colombia (Remote Friendly) R21h ago
-
Data Engineer Sr USD 42K-48KAzure | Azure Data | Azure Data Factory | Data Factory | Data WarehousingAdvanced English use | Client collaboration | Project extension opportunity | Remote workMid-level Full TimeVicente López, Argentina R21h ago
-
Software Engineer (Gen AI - Typescript/Python) USD 127K-135KAPI Integration | Django | Domain-Driven Design | Generative AI | Next.js401k match | Accidental death insurance | Dental coverage | Development allowance | Disability insuranceMid-level Full TimeRemote R21h ago
-
Senior Data Engineer, Hybrid CAD 100K-150KApache Airflow | Apache Beam | BigQuery | CI/CD | Cost OptimizationCourse Reimbursement Program | Flexible hybrid work environment | Free online doctor visits | Mental health support | Paid time offSenior-level Full TimeOakville, Canada R21h ago
-
Staff Software Engineer, Energy Analytics USD 165K-295KAWS | Argo | DBT | Docker | JavaRemote workSenior-level Full TimeUnited States R23h ago
-
Senior Machine Learning Engineer CAD 142K-190KAdvertising Auction | Airflow | BigQuery | Convolutional Neural Networks | Data Pipelines401k employer match | Caregiving support | Coaching benefits | Family planning support | Flexible vacationSenior-level Full TimeRemote - Ontario, Canada R23h ago
-
Senior Machine Learning Engineer USD 216K-303KAdvertising Auctions | Airflow | BigQuery | Convolutional Neural Networks | Deep learning401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Health care benefitsSenior-level Full TimeRemote - United States R23h ago