Data Engineer (Controls/Automation)
Irving, United States
WorldLink US
WorldLink is a leading provider of Data & Analytics services with a global reach and 25 years of experience.POSITION TYPE: Full Time (W2)
LOCATION: Irving, TX
ABOUT WorldLink:
WorldLink is a rapidly growing information technology company at the forefront of the tech transformation. From custom software development to cloud hosting, from big data to cognitive computing, we help companies harness and leverage today’s most cutting-edge digital technologies to create value and grow.
Collaborative. Respectful. Work hard Play hard. A place to dream and do. These are just a few words that describe what life is like at WorldLink. We embrace a culture of experimentation and constantly strive for improvement and learning.
We take pride in our employees and their future with continued growth and career advancement. We put TEAM first. We are a competitive group that like to win. We're grounded by humility and driven by ambition. We're passionate, and we love tough problems and new challenges. You don't hear a lot of "I don't know how" or "I can't" at WorldLink. If you are passionate about what you do and having fun while doing it; tired of rigid and strict work environments and would like to work in a non-bureaucratic startup cultural environment, WorldLink may be the place for you.
For more information about our craft, visit https://worldlink-us.com .
WHO we’re looking for:
We are looking for a Data Engineer (Controls/Automation) who will be a key contributor on a multi-functional team of Data and Software Engineers to transform complex analytical models in scalable, production-ready solutions. He or she will build data pipeline frameworks to automate high-volume and real-time data delivery for streaming and develop cloud-based applications from the ground up using a modern technology.
Role and Responsibilities:
- Building data APIs and data delivery services to support critical operational and analytical applications.
- Contributing to the design of robust systems with an eye on the long-term maintenance and support of the application.
- Leveraging reusable code modules to solve problems across the team and organization.
- Handling multiple functions and roles for the projects and Agile teams.
- Defining, executing and continuously improving our internal software architecture processes.
- Must have a minimum of 5 years of experience in designing and developing data pipelines for data ingestion or transformation.
- Bachelor's degree in Computer Science, Data Engineering, or related field is required.
- Experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS.
- Experience developing applications with Monitoring, Build Tools, Version Control, Unit Test, TDD, Change Management to support DevOps.
- Experience with SQL and Shell Scripting experience.
- Experience designing, building, and deploying production-level data pipelines using tools from Hadoop stack (HDFS, Hive, Spark, HBase, Kafka, NiFi, Oozie, Apache Beam, Apache Airflow etc).
- Experience with Spark programming (pyspark or scala or java).
- Experience troubleshooting JVM-related issues.
- Experience and strategies to deal with mutable data in Hadoop.
- Experience with Stream sets.
- Familiarity with machine learning implementation using PySpark.
- Experience in data visualization tools like Cognos, Arcadia, Tableau.
-
Self-motivated
individual with the ability to thrive in a team-based or
independent environment.
- Detail-oriented with strong
organization skills.
- Ability to work in a
fast-paced environment.
- Limited supervision
and the exercise of discretion.
The physical demands described here are representative of those that must be met by contract employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
While performing the duties of this job, the contract employee is occasionally required to stand, clean, crawl, kneel, sit, sort, hold, squat, stoop, stand, twist the body, walk, use hands to finger, handle, or feel objects, tools or controls, reach with hands and arms, climb stairs or ladders and scaffolding, talk or hear, and lift up to 20 pounds. Specific vision abilities required by the job include ability to distinguish the nature of objects by using the eye. Operate a computer keyboard and view a video display terminal between 50% - 95% of work time, including prolonged periods of time. Requires considerable (90%+) work utilizing high visual acuity/detail, numeric/character distinction, and moderate hand/finger dexterity.
Performs work under time schedules and stress which are normally periodic or cyclical, including time sensitive deadlines, intellectual challenge, some language barriers, and project management deadlines. May require working additional time beyond normal schedule and periodic travel.
WHAT we’ll bring:
During your interview process, our team can fill you in on all the details of our industry-competitive benefits and career development opportunities. A few highlights include:
-
Medical
Plans
- Dental
Plans
- Vision Plan
- Life &
Accidental Death & Dismemberment
- Short-Term
Disability
- Long-Term Disability
- Critical Illness/ Accident/ Hospital Indemnity/ Identity
Theft Protection
- 401(k)
Our success begins and ends with our people. We embrace diverse perspectives and value unique human experiences. WorldLink is an Equal Employment Opportunity and Affirmative Action employer. All employment at WorldLink is decided on the basis of qualifications, merit, and business need. We endeavor to continue our footprint as a diverse organization by highlighting opportunities for all people. WorldLink considers applicants for all positions without regard to race, color, religion or belief, sex, (including pregnancy and gender identity), age, national origin, political affiliation, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. People with disabilities who need assistance with any part of the application process should contact us.
This job description is designed to cover the main responsibilities and duties of the role but is not designed to be a comprehensive list of all.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow APIs Architecture Avro Big Data Computer Science Data pipelines Data visualization DevOps Engineering Hadoop HBase HDFS Java Kafka Machine Learning NiFi Oozie Parquet Pipelines PySpark RDBMS Scala Shell scripting Spark SQL Streaming Tableau TDD
Perks/benefits: Career development Health care Startup environment
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.