Data Engineer PK (Python/PySpark/AWS Glue/Amazon Athena/SQL/Apache Airflow)
Tasks
- Build optimize and scale data pipelines
- Build reusable frameworks and connectors for data publishing
- Design and operationalize ingest and transformation workflows
- Integrate pipeline health metrics into dashboards
- Model and implement scalable data transformations
- Monitor and alert on pipeline execution
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Alerting | Amazon Athena | Apache Airflow | Cost Optimization | DAG | Data Lineage | Data Modeling | Data Observability | Data Pipeline Monitoring | Data Quality | Data pipeline | ETL | Logging | Metrics | Pipeline monitoring | PostgreSQL | PySpark | Python | Retries | SLAs | SQL | Snowflake | Tracing | TypeScript
Education
N/A
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R11d ago
-
Featured Feat. Software Engineer USD 40K-150K.NET | APIs | AWS | Angular | AzureContractor hours flexibility | Remote workMid-level ContractRemote R18d ago
-
Featured Feat. Senior Software Engineer USD 80K-170KAlgorithms | C++ | Data Structures | Go | JavaContractor flexibility | Remote workSenior-level ContractRemote R18d ago
-
【27届校招】数据运维工程师 CNY 180K-300KBig Data | Docker | Function Calling | Go | Hybrid CloudHands-on practice | MentorshipNone Full Time广州 R4h ago
-
【27届校招】数据运维工程师 CNY 180K-300KAI Agent | Big Data | Containerization | Function Calling | GoMentorship | On-the-job trainingNone Full Time广州 R5h ago
-
Data Management Engineer Cloud ETL Sr COP 48000K-60000KAmazon Web Services | Cloud Computing | Cloud platform | Data Pipelines | Data QualityAdvanced English B2 plusMid-level Full TimeColombia R8h ago
-
Data / Search Specialist USD 125K-181KAccess Control | Amazon Athena | Amazon Bedrock | Amazon Bedrock Knowledge Bases | Amazon OpenSearchRemote work | Travel up to 10 percentSenior-level ContractRemote R8h ago
-
AI Application Engineer USD 153K-220KAWS | AWS Step Functions | Amazon Bedrock | Amazon Textract | AuthenticationRemote work | Travel up to 15% | US work authorization requiredSenior-level ContractRemote R8h ago
-
Senior AI DevEx Engineer USD 169K-220KAI-assisted coding | Application Lifecycle Management | Application lifecycle | Assisted coding | AutomationEquity | Flexible PTO | Medical coverage | Monthly lifestyle stipendSenior-level Full TimeRemote - Canada R10h ago
-
Sr. Associate Director, Software Engineering Specialist INR 1600K-2400KAirflow | Apache Beam | Apache Flink | BigQuery | CI/CDFlexible working | Inclusive workplace | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India R10h ago
-
Data Engineer (all genders) EUR 55K-70KCI/CD | Cloud | Cloud Data | Data Architecture | Data EngineeringFlexible work environment | Retirement plan | Sports benefits | Team events | Unrestricted employment contractMid-level Full TimeBerlin, Hamburg, Oldenburg, Remote, München, Aachen R13h ago
-
Analytics Engineer - Pricing data (f/m/d) EUR 45K-48KAWS | Airflow | BigQuery | CI/CD | DBTEquipment provided | International career opportunities | Technical certifications support | Training and development | Two days remote work per weekMid-level Full TimeLille, Upline, Nord, France; Paris, Paris, … R15h ago
-
Senior AI Engineer INR 2475K-4000KAgile | Amazon Web Services | CI/CD | CSS | ConfluenceHome office setup reimbursement | Mental wellness support | Ongoing learning & development | Paid time off | Recharge daysSenior-level Full TimeChennai or Remote, India R16h ago
-
AI Services | API Management | Agile | Apache Spark | Azure AICareer growth | Dental insurance | Health Savings Program | Hybrid work | International mobilitySenior-level Full TimeBrazil R17h ago
-
AWS | Big Data | Data Pipelines | Databricks | Distributed SystemsChildcare assistance | Dental insurance | Education assistance | Extended maternity leave | Extended paternity leaveSenior-level Full TimeBrazil R17h ago
-
Senior / Principal Infrastructure Engineer - ML Platform USD 278K-345KAWS | CI/CD | Cloud infrastructure | Cloud platform | Cluster managementEquity compensation | Onsite schedule Tuesday Wednesday ThursdaySenior-level Full TimeSan Mateo, CA, United States R17h ago
-
Mid-level Full TimeCarmel, Indiana- Hybrid OR St. Louis, … R22h ago
-
Convai Software Engineer NZD 70K-89KAWS Lambda | Amazon DynamoDB | Amazon S3 | Amazon Web Services | GitHome-based workMid-level Full TimeRemote Work Location - NZ, New … R22h ago
-
Forward Deploy Engineer, Aladdin Data, Associate INR 3715K-4401KApache Airflow | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsMid-level Full TimeM11 - Commers III, 43, 44 … R22h ago
-
Associate , Data Acquisition Engineering INR 1500K-3000K.NET | API Design | AWS | Apache Airflow | AzureComprehensive healthcare | Flexible time off | Retirement plan | Support for working parents | Tuition reimbursementMid-level Full TimeBL4 - KNG Tower 1, Indiqube … R22h ago
-
Senior AI Infrastructure Engineer, LLM/AI Platforms USD 140K-215KAWS | Airflow | Amazon SageMaker | Ansible | BatchingCompetitive vacation and holidays | Comprehensive wellness programs | Employee networks | Paid adoption leave | Paid parental leaveSenior-level Full TimeUSA VA Remote, United States R22h ago
-
API Integration | Batch Processing | BigQuery | CI/CD | Cloud platformCareer coaching | Career progression | Health insurance | Meal card | Welcome kitMid-level ContractLisbon R22h ago
-
API Integration | Apache Hadoop | Apache Hive | Apache Kafka | Apache SparkCareer progression | Discounts | Health insurance | Meal card | Welcome kitSenior-level ContractLisbon R22h ago
-
Business Intelligence AI/ML Engineer 3 (Nightshift) PHP 250K-450KAPI Development | Anomaly Detection | Batch Scoring | Classification | Data DriftSenior-level Full TimePhilippines - Virtual R22h ago
-
Data Engineer USD 83K-158KAngular | Continuous Delivery | Continuous integration | DevOps | Distributed SystemsMid-level Full TimeTwo Destiny Way, Westlake TX, United … R22h ago