Senior Data Engineer
Austin Technical Center - Austin Technical Center, United States
USD 125K-173K Senior-level Full Time
Tasks
- Automate infrastructure with Terraform
- Build batch and streaming workflows with Databricks
- Build real time data processing with Kafka and Azure Event Hub
- Create observability with Prometheus and Datadog
- Deploy scale manage services on Azure Kubernetes Service
- Design build support data engineering pipelines
- Design relational data models and database performance
- Develop backend services with reliability observability maintainability
- Implement CI/CD pipelines with GitHub Actions
- Implement cron based and event driven orchestration
- Implement resiliency patterns and durable fixes
- Improve load testing capacity planning and performance
- Integrate enterprise data via REST APIs and messaging
- Manage GitOps deployments with ArgoCD
- Mentor and coach engineers
- Monitor metrics logs traces dashboards alerts
- Perform code reviews testing documentation security monitoring
- Troubleshoot production issues conduct root cause analysis
Perks/Benefits
- Employee assistance program
- Flexible spending accounts
- Health savings account
- Paid vacation and holidays
- Relocation benefits
- Retirement savings plan
- Tuition assistance programs
Skills/Tech-stack
AKS | Apache Spark | ArgoCD | Azure | Azure Event | Azure Event Hub | Azure Kubernetes | Azure Kubernetes Service | CI/CD | Capacity Planning | Database performance | Database performance tuning | Databricks | Datadog | Distributed tracing | Docker | Encryption | Event Driven | Event Hub | Event-driven architecture | GitHub Actions | GitOps | Infrastructure as Code | Java | Kafka | Kubernetes | Kubernetes Service | Load Testing | Microservices | OAuth | Observability | OpenID Connect | Performance Tuning | PostgreSQL | Prometheus | Quarkus | Query Optimization | REST APIs | Relational databases | Secrets management | Spring Boot | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Data Engineer (remote) USD 85K-100KAgile | Apache Spark | Artificial Intelligence | Azure Data | Azure Data Factory401k match | Employee assistance program | Flexible schedule | Health insurance | Paid parental leaveMid-level Full TimeWork From Home, United States R7h ago
-
Mid-level Full TimeSalt Lake City, Utah9h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBlacksburg, United States9h ago
-
Sr. Tech Lead, GTM Applied AI & Analytics USD 150K-243KAirflow | Data Warehousing | Databricks | Fine Tuning | LLM APIsSenior-level Full TimeSan Francisco, CA, United States11h ago
-
Software Engineer, Machine Learning USD 185K-200KClassification | Computer Vision | Data Mining | Data Regression | Deep learningMid-level Full TimeMenlo Park, CA12h ago
-
AI Engineer, Professional Services, Google Cloud USD 183K-265KApache Beam | Apache Spark | C++ | Data Validation | Data WarehousingTechnical workshops | Travel opportunitiesSenior-level Full TimeAustin, TX, USA; Atlanta, GA, USA12h ago
-
Product Software Modernization Engineer, Quantum AI USD 147K-211KBazel | Cloud Spanner | Cloud Storage | Cloud platform | Distributed cloudMid-level Full TimeSeattle, WA, USA; Goleta, CA, USA12h ago
-
Software Engineer III, Infrastructure, GDC AI Storage USD 147K-211KCSI | Data Structures | Data Structures and Algorithms | Distributed Systems | GoSenior-level Full TimeKirkland, WA, USA12h ago
-
Automation | C++ | CSS | Database Design | HTMLMid-level Full TimeAnn Arbor, MI, USA12h ago
-
Software Engineering - DataStage Developer USD 112K-129KAxway | Axway Secure SFTP | Azure | Azure DevOps | CA7 SchedulerHybrid work schedule | Remote workMid-level Full TimeSyracuse, New York, United States15h ago
-
Senior Data Engineer - Knowledge Platform USD 160K-260KApache Airflow | Apache NiFi | Batch Processing | BigQuery | Cloud platformEquity compensation | Fully stocked kitchen | Open office space | Team building eventsSenior-level Full TimeUS - San Francisco19h ago
-
Software Engineer II - Abnormal Data Platform USD 149K-214KAerospike | Amazon DynamoDB | Apache Spark | Data Storage | DatabricksDistributed team collaboration | Remote work | Technical mentorshipMid-level Full TimeRemote - USA R19h ago
-
Robotics Application & Product Security Engineer USD 90K-300KAPI Security | Adversarial analysis | Application Security | Artifact signing | AuthenticationHybrid or remote optionSenior-level Full TimeIrvine, CA20h ago
-
Data Center Operations Systems Engineer (Dallas, TX) USD 89K-145KAirflow management | Aisle containment | Boot process | Cable Management | Cable Optics401k company match | Commuter stipend | Dental insurance | Flexible paid time off | Health insuranceMid-level Full TimeDallas, TX - Data Center21h ago
-
Applied AI ML Engineer-Senior Associate USD 175K-210KAWS | Amazon Bedrock | Amazon EKS | Amazon SageMaker | Data ShardingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeNew York, NY, United States22h ago
-
Machine Learning Engineer, Growth USD 130K-500KElasticsearch | Embeddings | Fine Tuning | Go | KafkaEquity grant | Free gym membership | Health insurance | Housing bonus | Meals stipendMid-level Full TimeSan Francisco22h ago
-
Senior Analytics Engineer USD 87K-161KData Lakehouse | Data mesh | Databricks | Delta Lake | ETL401k | Health insurance | Hybrid work | Paid time off | Remote workSenior-level Full TimeRemote-MO, United States R23h ago
-
Principal Software Engineer - Robotics & Drones USD 170K-200KAPIs | Accelerators | CPU | Camera Signal Processing | Cloud DataSenior-level Full TimeBoston, MA - USA, United States23h ago
-
Senior Geospatial Data Engineer USD 90K-189KAgile | ArcGIS Enterprise | ArcGIS Server | CI/CD | FionaFlexible time off | Learning resourcesSenior-level Full Time437 DENVER CO, United States23h ago
-
Lead, Data Platform Engineer USD 132K-150KApache Airflow | DBT | Data Pipeline Monitoring | Data Quality | Data Transformation401k retirement plan | Dental insurance | Health insurance | Holiday pay | Parental leaveSenior-level Full TimeUS063 NJ Raritan - 920 US …23h ago
-
Quantitative Analyst, Portfolio Engineering & Analytics USD 120K-135KAPI Development | AWS | Azure | Cloud platform | FastAPI401k matching | Employee stock purchase plan | Flexible paid time off | Health and wellbeing benefits | Hybrid work scheduleMid-level Full TimeBoston, United States23h ago
-
Scientist III, Data Engineer USD 161K-186KACID | API Gateway | AWS API | AWS API Gateway | AWS CodePipeline401k | Accident insurance | Commuter benefits | Dental insurance | Employee assistance programSenior-level Full TimeUS - Waltham, MA - 168 … R23h ago
-
Sr Engineer, Data Integration USD 101K-175K.NET | Azure | Cloverleaf Interface Engine | Csharp | EDIHealthcare benefits | Incentive programs | Professional development | Remote work | Retirement benefitsSenior-level Full TimeWork at Home - Ohio - … R23h ago
-
Tableau Developer USD 87K-157KAWS DevOps | Amazon Web Services | Azure | Azure DevOps | Dashboard DevelopmentMid-level Full Time6314 Remote/Teleworker US, United States R23h ago
-
Temporary Tableau Developer USD 86K-110KBusiness Intelligence | Dashboard Development | Data Analysis | Query Optimization | SQLFree sunglasses | Hybrid workMid-level TemporaryLos Angeles1d ago