Senior Software Engineer, Data Infrastructure
Tasks
- Build data processing pipelines
- Build unified feature store
- Design data storage systems
- Improve data pipeline reliability
- Ingest external data sources
- Process prediction and evaluation metrics
- Scale data infrastructure
- Store and load large weather datasets
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Beam | Apache Flink | Apache Kafka | Apache Spark | BigQuery | Cloud platform | Data Observability | Data Versioning | Data Warehousing | Data debugging | Data pipeline | Distributed Systems | Feature Store | Flyte | Google Cloud | Google Cloud Platform | Kubernetes | Machine Learning | Machine Learning Infrastructure | Object storage | PostgreSQL | Python | Schema evolution | Temporal | Terraform | Time Series | Time-series databases | Unit Testing
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Active Learning | DPO | Deep learning | Few-Shot Learning | Few-shotSenior-level Full TimeMountain View, CALIFORNIA, United States4h ago
-
Forward Deployed AI Engineer USD 150K-170KAPIs | Conversational AI | Hugging Face | LLM | Langchain401k | Community involvement | Dental insurance | Disability insurance | Flexible spending accountsMid-level Full TimePalo Alto, United States8h ago
-
Data Engineer II-AWS USD 90K-100KAWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDB | Amazon EMRFully remote workMid-level Full TimeOrlando, FL, United States R9h ago
-
Senior Full Stack AI Developer USD 145K-180KArtificial Intelligence | Cloud Computing | Continuous Delivery | Continuous integration | Language ModelsRemote workSenior-level Full TimeWork from home, VA, United States R10h ago
-
Senior Embedded Software Engineer USD 142K-182KAMD Xilinx | ARM Cortex | C# | Digital Signal Processing | Embedded Linux401k match | Dental insurance | Employee assistance program | Every other Friday off | FSASenior-level Full TimeCamarillo, CA, United States10h ago
-
Data Engineering and Data Analyst (exp in SAP Data) USD 107K-160KClustering | Data Modeling | Data Observability | Data pipeline | Data pipeline orchestrationSenior-level Full TimeBoston, MA, United States10h ago
-
Senior Data Engineer USD 130K-175K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R11h ago
-
Analytics Engineer USD 89K-140KAnalytics | Azure Data | Azure Data Factory | DAX | Data Factory401k match | Dental insurance | Health insurance | Health savings account | Life insuranceMid-level Full TimeMurrysville, PA, United States11h ago
-
Senior-level Full TimeAustin, TX, United States12h ago
-
AWS Glue | Amazon Redshift | Amazon SageMaker | Data Modeling | Data PipelinesMid-level Full TimeHouston, TX, United States12h ago
-
Data Engineer USD 90K-125KAnomaly Detection | Azure | Data Analysis | Data Migration | Data Modeling401k | Dental insurance | Disability coverage | Employee assistance program | Flexible spending accountsMid-level Full TimeSt. Louis, MO, United States12h ago
-
Agile | Automation | Azure AD | Azure Monitor | Azure SentinelKnowledge transfer opportunities | Long-term contract | Onsite in Deerfield Beach FLSenior-level ContractDeerfield Beach, United States13h ago
-
AWS S3 | Amazon Redshift | Apache Airflow | Azure Storage | Cloud PlatformsSenior-level ContractLincoln, United States R13h ago
-
Machine Learning Engineer, Physical AI USD 150K-200KAWS | CUDA | Computer Vision | Deep learning | FastAIBi-annual offsites | Dental insurance | Flexible PTO | Health insurance | Learning and development budgetMid-level Full TimeSan Francisco, CA, US13h ago
-
Robotics Systems Engineer, Physical AI USD 150K-200KCalibration | Computer Vision | Data pipeline | Deep learning | DockerDental insurance | Flexible PTO | Health insurance | Learning and development budget | Monthly socialsMid-level Full TimeSan Francisco, CA, US13h ago
-
Head of AI USD 150K-300KAPI Integration | AWS | Artificial Intelligence | Automations | ChatGPT401k with company matching | Dental insurance | Fully remote work environment | Health insurance | Vision insuranceExecutive-level Full TimeAustin, Texas, Austin HQ, Dallas, Texas, … R13h ago
-
AWS Data Architect USD 140K-216KAPI Integration | AWS CloudFormation | AWS Glue | AWS Lake Formation | AWS LambdaOnsite daily at officeSenior-level Full TimeFremont, United States14h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Apache Airflow | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeTampa, United States14h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeFort Lauderdale, United States14h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flextime with remote and office options | Mentorship | Personalized growth roadmapsSenior-level Full TimeJacksonville, United States14h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Amazon SageMaker | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeOrlando, United States14h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeTallahassee, United States14h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | DuckDBFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsSenior-level Full TimeBaltimore, United States14h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | Data LakeEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeRichmond, United States14h ago
-
Data Engineer ID50062 USD 148K-164KAWS SageMaker | Amazon Web Services | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Remote and office options | TechtalksSenior-level Full TimeMiami, United States14h ago