Presentation: Elasticsearch powers the Citizen Advice Bureau (CAB) to monitor trends in society before they become issues

The DataKind UK team is assisting the CAB to make sense of online usage of their services and in-person visits to their centres. They have more centres in the UK than Tesco has shops and data going back 10+ years of every person they assisted classified by problem type and geo data.

Datakind UK took 3 types of data: 1. All of their Google Analytics data on their advice guide website (a self-help version of going into one of their offices) 2. The records of all the physical office visits (~2M people and 6M issues per year), which are essentially just a date, an office ID, and the issue code the person was seen for. 3. ~50K/year detailed write ups of critical cases. These have 6 text fields and about 40 demographic fields.

They indexed all of these data sets in Elasticsearch and normalised across all their fields, so that they were searchable across any of the common fields (date, location, issue code) and allowed deep exploration of the data types individually. They then built a Kibana 4 dashboard on top of all of this to allow CAB staff do the data exploration themselves.

On average, about 5,700 people walk into their local Citizens Advice Bureaux every single day; one of over 3,000 locations in communities and high streets across England and Wales. Every day about 69,000 people look for help through Advice Guide, the online advice service, and over 4,300 more reach CAB on the phone.


Covering innovative topics

Wednesday, 4 March

  • Architecture Improvements

    Next gen architecture, Arch over the full lifecycle, Bleeding edge tech in legacy, Cognitive biases in architecture, Evolving Architecture.

  • Big Data Frameworks, Architectures, and Data Science

    As big data tools and architectures continue to evolve, how do you architect and select technologies that work now but are also future-proof?

  • DevOps and Continuous Delivery: Code Beyond the Dev Team

    As infrastructure becomes as malleable as code, a unified approach from reqs to ops is needed to deliver promised breakthroughs.

  • Engineering Culture

    The best teams and companies talk about how to create amazing engineering cultures.

  • Java - Not Dead Yet

    Java is evolving to meet developer and business needs, from lambdas in Java 8 to built-in support for money types rumoured for Java 9.

  • Mind Matters at Work

    How theories from neuroscience and psychology can help us better understand IT professionals and discover what really motivates them.

Thursday, 5 March

  • Docker, containers and application portability

    People building stuff for and with containers showing why application portability is important, and what can be done with expanding ecosystems.

  • Evolving agile

    Reflecting on and learning from successes and failures in applying agile approaches since the creation of the Agile Manifesto and exploring ways of applying agile practices to increase business value.

  • HTML and JS Today

    The state of the art in web technologies. What is important to know and why?

  • Internet of Things

    What software devs need to know to design and build for instrumented environments and reactive things, what new issues and questions it raises.

  • Modern CS in the Real World

    How modern CS helps you tackle today's problems.

  • Reactive Architecture

    How to create reactive systems is more than simply learning a framework. Thinking in a reactive way helps you to design responsive architectures.

  • The Go Language

    The Go Language - Concurrency, Performance, Systems Programming.

Friday, 6 March

  • Architectures You've Always Wondered About

    Get a rare look behind the scenes and get to see the architectures of the most well-known sites with the least known architectures.

  • Low latency trading

    The 'race to zero' continues. Join us to learn about the latest tecniques being deployed to optimise order routing and execution.

  • Open source in finance

    Financial services have changed from OS as cost-saving to a competitive weapon. See open source projects that are disrupting the finance industry.

  • Product Mastery

    Come have fun with fellow PMs and BAs as you learn about Value Management. We'll even tell you dark tales of Snarks, Hippos and other obstacles.

  • Taming Microservices

    Tackling the challenges of microservices in practice.

  • Taming Mobile

    Mobile is no longer the Next Big Thing but a requirement for your business. Hear from those who have implemented successful mobile systems.

Conference for Professional Software Developers