Senior Data Engineer
Tasks
- Build data integration pipelines on AWS
- Build data processing applications with PySpark
- Catalog datasets with Glue Crawlers
- Create AWS Lambda functions with Python
- Deploy applications with Docker containers
- Develop REST APIs with FastAPI
- Develop data pipelines with AWS Glue ETL
- Develop data pipelines with EMR
- Implement API authentication with OAuth2 and JWT
- Implement event driven pipelines with Kafka
- Monitor and troubleshoot jobs with CloudWatch
- Optimize Spark jobs
- Orchestrate workflows with AWS Step Functions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS Step Functions | AWS Wrangler | Amazon Athena | Amazon DynamoDB | Amazon EMR | Amazon EventBridge | Amazon S3 | Apache Iceberg | Apache Kafka | Avro | Boto3 | CloudWatch | Docker | Docker EKS | FastAPI | Flask | HDFS | JSON | JSON Web Token | MongoDB | OAuth2 | ORC | Pandas | Parquet | PySpark | Python | REST APIs | Requests | SQL | Step Functions | XML
Education
Roles
Related jobs
-
AI Engineer USD 109K-140KAgent Orchestration | Computer Vision | Data Validation | Data extraction | Document ClassificationMid-level Full TimeMorristown, NJ, United States6h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeExposure to real-world projects | Learning and development opportunities | MentorshipEntry-level InternshipBoston, MA, United States6h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeMentorshipEntry-level InternshipBoston, MA, United States6h ago
-
Early-Career Network Engineer (RAN Optimization) USD 85K-130K4G | 5G | Automation | C Band | CBRS401k match | Dental insurance | Disability insurance | Educational assistance | Financial wellness programsMid-level Full TimePlano,Texas,United States R6h ago
-
Senior Embedded Software Engineer USD 146K-196KARM Cortex | C# | Digital Signal | Digital Signal Processing | Embedded Linux401k match | Dental insurance | Employee assistance program | FSA | Flexible scheduleSenior-level Full TimeCamarillo, CA, United States6h ago
-
Data Engineer USD 126K-208KAPI Integration | Airflow | Amazon Web Services | BigQuery | CCPADEI initiatives | Dental benefits | Employee rewards program | Medical benefits | Mental health supportMid-level Full TimeRemote, United States R6h ago
-
Alerting | Ansible | Bash | CI/CD | CephRemote workSenior-level Full TimeUnited States, United States R7h ago
-
Ansible | Bash | CI/CD | CentOS | CephContract-to-hire | No sponsorship | Remote workSenior-level Full TimeUnited States, United States R7h ago
-
HPG Big Data Engineer / Senior-Level USD 119K-164KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure FunctionsSenior-level Full TimeNashville, TN, United States8h ago
-
Platform and Integrations Engineer USD 100K-200KAnthropic | GraphQL | Next.js | Node.js | OpenAIIn-person work | Medical/Dental/Vision | Significant equity upsideEntry-level Full TimeSan Francisco, CA, US9h ago
-
Machine Learning Engineer USD 131K-178KAWS | Cassandra | Convolutional Neural Networks | Data Lakes | Data PipelinesMid-level Full TimeRemote, NY, US R9h ago
-
Case design | Data Integrity | Database Testing | Database optimization | Defect ReportingSenior-level Full TimeAustin, TX R10h ago
-
Amazon S3 | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeNew York10h ago
-
Amazon S3 | Automation | Data Engineering | Data Modeling | Data Pipelines401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton10h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 119K-198KAPI Integration | AWS | Airflow | Azure | CI/CDTravelSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …11h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 189K-372KAPI Integration | AWS | Airflow | Apache Spark | AzureSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …11h ago
-
Lead AI and Data Solutions Engineer II USD 137K-229KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud ComputingSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …11h ago
-
Data Engineer | TS/SCI Required USD 93K-155KApplication Security | Cloud Engineering | Data Management | Data Security | Full StackMid-level Full TimeTampa, Florida, United States11h ago
-
AI & Data Supply Chain Engineer USD 116K-229KCapacity modeling | Data Modeling | Demand Planning | Enterprise Resource Planning | Inventory PlanningTravel 50%Mid-level Full TimeSeattle, Washington, United States11h ago
-
TikTok Shop - E-commerce Anti-Fraud Data Scientist USD 156K-296KA/B | A/B Testing | Analytics | B testing | Big DataMid-level Full TimeSeattle, Washington, United States11h ago
-
Software Engineer, Systems ML - SW/HW Co-design USD 117K-173KAI infrastructure | Bias Mitigation | C# | C++ | Co-designSenior-level Full TimeSunnyvale, CA | Redmond, WA12h ago
-
Software Engineer, Machine Learning USD 213K-293KAPI Design | Agent Orchestration | Artificial Intelligence | Bias Mitigation | C++Senior-level Full TimeSunnyvale, CA | Remote, US | … R12h ago
-
Staff Software Engineer, AI/ML Performance USD 207K-300KAlgorithms | Auto sharding | C++ | Code debugging | Code generationSenior-level Full TimeSunnyvale, CA, USA12h ago
-
C++ | Data Processing | Debugging | Deep learning | Few-Shot LearningSenior-level Full TimeMountain View, CA, USA12h ago
-
GTM Applied AI Architect, Google Cloud USD 153K-222KAgent Development | Agent Development Kit | Cloud platform | Function Calling | GeminiSenior-level Full TimeAustin, TX, USA; Boulder, CO, USA12h ago