Data Engineer (Elastic/Logstash Experience) Job at Infinitive Inc, Ashburn, VA

K01BRVduSkFWTHlUMEJ2M1I1K3Q4Uzlr
  • Infinitive Inc
  • Ashburn, VA

Job Description

*Candidates must be local to the Washington D.C. metro area and possess work authorization which does not require sponsorship by the employer for a visa.

About Infinitive:

Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment. Infinitive has been named “Best Small Firms to Work For” by Consulting Magazine 6 times most recently in 2023. Infinitive has also been named a Washington Post “Top Workplace”, Washington Business Journal “Best Places to Work”, and Virginia Business “Best Places to Work.”

Job Summary:

We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and be proficient in using Logstash and Databricks for data processing and analytics. This role is critical in helping us manage and optimize our clients data pipelines, ensuring the availability, reliability, and performance of our data infrastructure.

Responsibilities:

  • Design, develop, and maintain data pipelines using Logstash and Databricks to ingest, process, and transform data from various sources.
  • Collaborate with data scientists and analysts to understand their data requirements and ensure the data engineering infrastructure can support their needs.
  • Optimize data pipelines for efficiency, scalability, and performance to meet business objectives.
  • Troubleshoot and resolve issues related to data processing and pipeline failures.
  • Ensure data security and compliance with relevant data protection regulations.
  • Document data engineering processes and procedures for future reference and knowledge sharing.
  • Stay up-to-date with the latest trends and best practices in data engineering and cloud-based data processing technologies.

Requirements:

  • Bachelor's degree in computer science, information technology, or a related field. A master's degree is a plus.
  • Proven experience as a data engineer with a focus on data processing and integration.
  • Strong knowledge and hands-on experience with Elasticsearch.
  • Proficiency in Databricks for data analytics, ETL, and data engineering.
  • Familiarity with big data technologies such as Apache Spark is a plus.
  • Solid understanding of data warehousing concepts and relational databases.
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Knowledge of data modeling and data warehouse design principles.
  • Excellent problem-solving and debugging skills.
  • Strong teamwork and communication skills to collaborate effectively with cross-functional teams.

Preferred Qualifications:

  • AWS Certified Data Analytics - Specialty or relevant certifications.
  • Experience working with data streaming technologies like Apache Kafka or Amazon Kinesis.
  • Knowledge of DevOps practices for CI/CD pipelines.
  • Familiarity with data governance and data quality best practices.
  • Experience with version control systems like Git.

Infinitive is an Equal Opportunity Employer.

Job Tags

Full time, Local area,

Similar Jobs

PwC

Managed Services - Test Data Management (TDM) Analyst - Senior Associate Job at PwC

 ...individuals combine technical experience with creative thinking to deliver...  ...and deliver value at this level include but are not limited to...  ...development areas.+ Interpret data to inform insights and recommendations...  ...intend to hire experienced or entry level job seekers who will... 

Santa Margarita Toyota

BDC Agent / Representative Job at Santa Margarita Toyota

 ...retail and customer service experience is a plus, we're really looking...  ...--- and dont worry, we will train you! It really is a lot of fun...  ...customers. Establish and maintain good working relations within...  ...Vehicle purchase plan PAY: $17.00/hr - $21.50/hr plus... 

Shanghai Bowai Education company

Best environment in the world//No office hours//August 2025//(up to 35K RMB/month + free housing+3 months’ paid holiday) Middle/High school Science/Math Teachers Needed in August 2025 in Qionghai city, Hainan province, China Job at Shanghai Bowai Education company

Position: (1) American Middle/High School Science position; 2Middle/High School AP Calculus and statistics position; Description:1. Starting Date: late August 2025; 2. Students: G7-G12 students aged 13-18years old; 3. Working hours: up to 20 classes of 40 minutes...

Scrap Metal Services, LLC.

Hot Pit Loader Operator - Jackson, TN Job at Scrap Metal Services, LLC.

 ...Services has an outstanding opportunity for a Hot Pit Loader Operator for our mill service operation in Jackson, TN. This is a specialty...  ...but not limited to loaders, cranes, excavator, forklifts, skid steers, etc. Move scrap material around the yard Operate various... 

Agency

Part-Time Cybersecurity Vendor Management Assistant (Richmond) Job at Agency

 ...Location: On-site at our office in Richmond, VA Hours: 10-15 hours per week Ideal for: College students studying Computer Science, IT, Cybersecurity, or a related technical degree About the Role: We are seeking a Cybersecurity Vendor Management Assistant...