air-recruitment logo Facebook icon Twitter icon Linkedin icon Home icon

Data Engineer

  • £60k
  • Central London

Data Engineer, Central London – Up to £60k DOE plus benefits

This tech business are experts at understanding the impact of political narratives on local audiences. They’re currently looking to hire a Data Engineer interested in managing big data social media projects at the forefront of the intersections between cyber security, current affairs, civil society and the digital space.

The requirements for this Data Engineer are:

  • Experience working in SQL, such as MySQL, SQLite or another relational database
  • Interest in creating and maintaining data architecture
  • Experience with a widely used data science programming language, such as R or Python
  • Experience with collecting data from APIs
  • Familiarity with web scraping
  • Experience working with big data from social media APIs

The key responsibilities of this Data Engineer will be to:

  • Maintain a secure environment for data management and access, including managing databases
  • Monitor and evaluate data quality
  • Provide data to analysts and assist with queries; advise on feasibility of projects in terms of data availability and appropriateness
  • Work with developers to create and operationalize new tools and products. This will include implementing NLP models at scale on cloud servers
  • Collect data from APIs and Third party services, including Twitter, PushShift and Brandwatch
  • Scope out new data collection opportunities, and manage access.
  • Work on both sprints to respond to immediate business opportunities and longer term development projects