Senior Data Platform Engineer
Tasks
- Build ETL/ELT processes
- Collaborate with data engineers and architects
- Design data pipelines
- Implement data integrations
- Monitor production support queue
- Operate data platform systems
- Optimize and tune queries
- Provide production support on call
- Refine data requirements
- Respond to data flow failures
- Support data governance metadata requirements
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Lambda | Access Control | Apache Airflow | Attribute-Based Access Control | Attribute-based access | Azure | Azure Functions | CI/CD | CSV | Cloud Computing | Cloud Functions | Data Catalog | Data Governance | Data Pipelines | Databricks | ELT | ETL | GCP | Google Cloud | Google Cloud Functions | Infrastructure as Code | JSON | Java | Metadata Management | Microbatch | OIDC | Power BI | Python | Query Optimization | REST API | Redshift | SCIM | SFTP | SOAP API | SQL | Scala | Serverless | Snowflake | Streaming | Tableau | Web Services | XML | “as-code”
Education
Related jobs
-
Senior Data Engineer-JT0224 USD 120K-180K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R4h ago
-
Visualization Engineer - Journeyman USD 105K-155KAccess Control | Dashboard Development | Data Governance | Data Modeling | Data TransformationMid-level Full TimeFAIRFAX, VA, United States5h ago
-
Software Engineer 3-BP-184 USD 78K-250KCI/CD | Confluence | Docker | FluxCD | Git401k match | Employee referral programs | Flexible spending accounts | Flexible work arrangements | Mental health supportMid-level Full TimeHanover, MD6h ago
-
Software Engineer 3-BP-181 USD 78K-250KCI/CD | Docker | Git | GitLab | GitOps401k match | Dental insurance | Employee referral programs | Flexible spending accounts | Flexible work arrangementsSenior-level Full TimeHanover, MD6h ago
-
Staff Backend Engineer (AI Platform team) USD 185K-242KAWS | Agent Frameworks | Compliance | Data Privacy | DatadogEquity | Flexible PTO | Medical coverage | Monthly lifestyle stipendSenior-level Full TimeRemote - United States & Canada R7h ago
-
.NET | AWS S3 | Amazon RDS | DTCC RTTM | DTCC Settlement WebContract through June 2027 | East Coast location flexibility | Remote workSenior-level ContractNew York, United States8h ago
-
Senior-level Full TimeTampa, FL, US8h ago
-
Senior-level Full TimeUS-NY-New York9h ago
-
AI and Data Science Engineer (TS/SCI Poly) USD 93K-163KAPIs | Artificial Intelligence | CI/CD | Cloud Platforms | ContainerizationMid-level Full TimeMcLean, Virginia, United States9h ago
-
Managed Services Engineer III USD 119K-198KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLouisville, Kentucky, United States9h ago
-
Distributed Systems | Linux | Machine Learning | Network Programming | Performance AnalysisSenior-level Full TimeSan Jose, California, United States9h ago
-
Senior AI/ML Engineer USD 117K-195KAPI Development | AWS | AWS SageMaker | Airflow | AzureCareer growth | Customer-focused work | Onsite Pentagon work | Rapid advancementSenior-level Full TimeUSA-VA-Arlington9h ago
-
Mid-level Full TimeUSA-VA-Arlington9h ago
-
AI Forward Deployment Engineer USD 130K-145KAPIs | AWS | Airflow | Artificial Intelligence | AzureClient site travel | On-site workEntry-level Full TimeNew York, New York, United States9h ago
-
Machine Learning Engineer USD 142K-215KAgentic AI | Bayesian Inference | Code review | Deep learning | Error correctionMid-level Full TimeBoston, MA, US10h ago
-
AI Solutions Engineer USD 119K-207KAPIs | Azure | Business Process | Business process automation | Copilot StudioHybrid workSenior-level Full TimeCenter, Center District, IL10h ago
-
Staff Software Engineer, Generative AI USD 207K-300KAndroid | C++ | Computer Vision | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA10h ago
-
RTL Design Engineer, Machine Learning Accelerators USD 138K-198KASIC | Code review | High Performance | High-Performance Design | Learning algorithmsMid-level Full TimeSunnyvale, CA, USA10h ago
-
C++ | Computer Graphics | Data Curation | Data Pipelines | Human-in-the-loopSenior-level Full TimeNew York, NY, USA; Mountain View, …10h ago
-
Senior Software Engineer, Managed Spark, OpenSource USD 174K-252KApache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache SparkSenior-level Full TimeSunnyvale, CA, USA10h ago
-
Software Engineer III, AI/ML Machine Learning, Core USD 147K-211KC++ | Compute Technologies | Data Preprocessing | Data Storage | Distributed SystemsSenior-level Full TimeNew York, NY, USA; Mountain View, …10h ago
-
Research Scientist, Google Research, GenAI, Experiences USD 147K-211KComputer Vision | Data Mining | Deep learning | High Performance | High-Performance ComputingMid-level Full TimeMountain View, CA, USA; Kirkland, WA, …10h ago
-
Staff Software Engineer, Storage USD 207K-301KC# | C++ | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA10h ago
-
Software Engineer, AI/ML Computer Vision USD 147K-211KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsMid-level Full TimeSeattle, WA, USA; Kirkland, WA, USA10h ago
-
Senior Staff Software Engineer, TPU Performance USD 262K-365KAuto sharding | Benchmarking | C++ | Compiler optimization | Computer EngineeringBenefits | Bonus | EquitySenior-level Full TimeSunnyvale, CA, USA10h ago