Open Credo

Showing all blogs in category Blog

Use Case: A Kafka Backup Solution

February 22, 2024 | Blog, Kafka

Use Case: A Kafka Backup Solution

Check out Peter Vegh’s latest blog where he explores a bespoke Kafka backup framework, discussing the approach, architecture and design process to implement and deliver the solution.

Read More Read More

The Importance of Chunking in RAG

February 6, 2024 | AWS, Blog, OPA

The Importance of Chunking in RAG

Check out the latest blog by our Consultant, Tristan Hosken, as he explores Retrieval Augmented Generation (RAG). Tristan provides insights into advantages and disadvantages of RAG through hands-on experiments with AWS’s Bedrock and Azure’s OpenAI service.

Read More Read More

GOTO Amsterdam 2023 – Why is it so Hard to Create a Great Platform-as-a-product? (Recording)

February 1, 2024 | Blog, Platform Engineering

GOTO Amsterdam 2023 – Why is it so Hard to Create a Great Platform-as-a-product? (Recording)

Watch the recording of our CEO/CTO, Nicki Watt from the GOTO Amsterdam Conference 2023 on her talk “Why is it so Hard to Create a Great Platform-as-a-product?”

Read More Read More

Let’s Flink on EKS: Data Lake Primer

November 22, 2023 | Blog, Data Analysis

Let’s Flink on EKS: Data Lake Primer

Check out the latest blog by Our Senior Consultant Howard Hill where he offers an engineer’s guide to streamlining real-time data using an open-model infrastructure.

 

Read More Read More

How to use LLMs to Generate Coherent Long-Form Content using Hierarchical Expansion

October 30, 2023 | Blog

How to use LLMs to Generate Coherent Long-Form Content using Hierarchical Expansion

As impressive as they are, Large Language Models (LLMs) face difficulties when creating long-form content, primarily due to token limitations and inconsistencies in the output over time.

Together with Livy.ai, we developed a “Hierarchical Expansion” method to address these challenges and better the quality, flow, and structure of the content produced. Read further to learn more!

Read More Read More

Event Driven Load Testing

October 12, 2023 | Blog, Platform Engineering

Event Driven Load Testing

Check out our latest blog “Event Driven Load Testing” which explores how, through some smart automation techniques, testing strategies can be adapted to support scale-up organisations where there are potentially many disparate teams needing to work together.

Read More Read More

The Why’s, What’s and How’s of Kubernetes Operators

September 27, 2023 | Blog, Kubernetes

The Why’s, What’s and How’s of Kubernetes Operators

Learn to create your first Kubernetes operator by checking out our Senior Consultant Michal Tusnio’s latest blog, “Kubernetes Operators – Whys, Hows and Whats” where he takes you on a journey from zero to operator.

Read More Read More

Yow! London – Searching for Research Fraud in OpenAlex with Graph Data Science (Recording)

September 19, 2023 | Blog, Data Analysis

Yow! London – Searching for Research Fraud in OpenAlex with Graph Data Science (Recording)

Check out our Lead Consultant Ebru Cucen and Sage Publishing Data Scientist Adam Day co-present on “Research Fraud Detection in OpenAlex with Graph Data Science” at YOW! London 2022.

Read More Read More

The 2023 Mayor’s Business Climate Challenge (BCC) – Part 2

September 19, 2023 | Blog, Culture, News

The 2023 Mayor’s Business Climate Challenge (BCC) – Part 2

In this blog we share the latest developments in our efforts to create a more sustainable business as part of The 2023 Mayor’s Business Climate Challenge.

Read More Read More

OpenCredo awarded Britain’s Healthiest Workplace for SMEs

September 8, 2023 | Blog

OpenCredo awarded Britain’s Healthiest Workplace for SMEs

We were recently awarded ‘Britain’s Healthiest Workplace for SMEs’ by Vitality. Read on to learn more about our journey to achieving this award and what we are doing to improve our workplace culture.

Read More Read More

Why should you upgrade your Terraform provider to the latest version of the API

August 17, 2023 | Blog, Terraform Provider

Why should you upgrade your Terraform provider to the latest version of the API

Check out John Sharpe and Will May’s latest blog where they give suggestions for Terraform Provider authors who are thinking about upgrading from SDKv2 to Framework

Read More Read More

PlatformCon: Tops and flops (Recording)

July 20, 2023 | Blog, Platform Engineering

PlatformCon: Tops and flops (Recording)

Watch the recording of our CEO/CTO Nicki Watt and other PlatformCon Conference speakers discussing the highlights and lowlights of the talks and the Platform Engineering community, as well as lessons learned and trends spotted.

Read More Read More

PlatformCon 2023 – Why is it so hard to create a great Platform-as-a-Product? (Recording)

July 11, 2023 | Blog, Platform Engineering

PlatformCon 2023 – Why is it so hard to create a great Platform-as-a-Product? (Recording)

Check out our CEO/CTO, Nicki Watt’s, talk “Why is it so hard to create a great Platform-as-a-Product?” from the PlatformCon Conference 2022.

Read More Read More

PlatformCon 2023 – The Golden Age of the Platform (Recording)

July 5, 2023 | Blog, Platform Engineering

PlatformCon 2023 – The Golden Age of the Platform (Recording)

Watch the recording of our Technical Delivery Director, James Bowkett from the PlatformCon Conference 2023 in his talk The Golden Age of the Platform.”

Read More Read More

Cloud for Business in 2023: Raconteur and techUK webinar (Recording)

June 13, 2023 | Blog, Cloud

Cloud for Business in 2023: Raconteur and techUK webinar (Recording)

Check out the recording of our CEO/CTO Nicki Watt, and other panellists at the Raconteur and techUK webinar discussing “The Cloud for Business Report,” which was published in The Sunday Times on 5th March 2023.

Read More Read More

Kafka: Navigating GDPR Compliance

June 8, 2023 | Blog, Kafka

Kafka: Navigating GDPR Compliance

Check out Greg Nuttall’s latest blog where he looks at the challenges posed by GDPR’s “Right to be Forgotten” in the context of Apache Kafka, and delves deeper into three strategies for overcoming them.

Read More Read More

Building the best Kubernetes test cluster on MacOS

May 18, 2023 | Blog, Kubernetes

Building the best Kubernetes test cluster on MacOS

Check out Matthew Revell-Gordon’s latest blog as he explores building a local Kubernetes test cluster to better mimic cloud-based deployments, using Colima, Kind, and MetalLB.

Read More Read More

TL;DR – Computational Governance in Data Mesh with OPA

April 21, 2023 | Blog, Data Engineering, Data Governance, Data Mesh, OPA

TL;DR – Computational Governance in Data Mesh with OPA

Check out Mateus Pimenta’s TL;DR video to learn how federated computational governance could be implemented using Open Policy Agent (OPA) and policy-as-code to support a successful Data Mesh architecture.

Read More Read More

State of Open Conference – Internal Developer Platforms of the people, by the people, for the people (Recording)

March 29, 2023 | Blog, Kubernetes, Platform Engineering

State of Open Conference – Internal Developer Platforms of the people, by the people, for the people (Recording)

Watch the recording of our CEO/CTO, Nicki Watt from the State of Open Conference on her talk “Internal Developer Platforms – Of the people, By the people, For the people.”

Read More Read More

Ingesting Big Data into Neo4j – Part 3

March 9, 2023 | Blog, Data Analysis, Neo4j

Ingesting Big Data into Neo4j – Part 3

Check out the last part of Ebru Cucen and Fahran Wallace’s blog series, in which they discuss their experience ingesting 400 million nodes and a billion relationships into Neo4j and what they discovered along the way.

Read More Read More

Ingesting Big Data into Neo4j – Part 2

February 16, 2023 | Blog, Data Analysis, Neo4j

Ingesting Big Data into Neo4j – Part 2

Check out Part 2 of Ebru Cucen and Fahran Wallace’s blog series, in which they discuss their experience ingesting 400 million nodes and a billion relationships into Neo4j and what they discovered along the way.

Read More Read More

NODES 2022 – Neo4j Online Developer Education Summit 2022 – Tracing your data’s DNA

February 1, 2023 | Blog, Data Analysis, Neo4j

NODES 2022 – Neo4j Online Developer Education Summit 2022 – Tracing your data’s DNA

As data becomes ubiquitous and deeply interconnected, tracing where who or which system that data comes from – its lineage – will create bigger problems and opportunities for us on the horizon. Watch the recording of James Bowkett talk from NODES 2022 – Neo4j Online Developer Education Summit 202 on ‘Tracing Your Data’s DNA.’

Read More Read More

Ingesting Big Data into Neo4j – Part 1

January 26, 2023 | Blog, Data Analysis, Neo4j

Ingesting Big Data into Neo4j – Part 1

Fahran Wallace and Ebru Cucen’s most recent blog post is part 1 of a three-part series. They investigate how OpenCredo ingested 400 million nodes with a billion relationships into Neo4j.

Read More Read More

The 2022/2023 Mayor’s Business Climate Challenge (BCC)

January 20, 2023 | Blog, Culture, News

The 2022/2023 Mayor’s Business Climate Challenge (BCC)

OpenCredo is thrilled to be a part of the 2022/2023 Mayor’s Business Climate Challenge (BCC). Read this blog to learn more about our initiatives to lower carbon emissions as part of the voluntary energy efficiency programme!

Read More Read More

Kubernetes Community Days – Kubernetes-based platforms – of the people, by the people, for the people (Recording)

December 8, 2022 | Blog, Kubernetes, Platform Engineering

Kubernetes Community Days – Kubernetes-based platforms – of the people, by the people, for the people (Recording)

Watch the recording of our CEO/CTO, Nicki Watt from the Kubernetes Community Days on her talk “Kubernetes-based platforms – of the people, by the people, for the people.”

Read More Read More

Seeing Through The Modern Data Stack

December 7, 2022 | Blog, Data Analysis

Seeing Through The Modern Data Stack

Learn more about data processing and analytics, which are essential systems in modern enterprises but are frequently overlooked aspects of modern data architectures, by reading Mateus Pimenta’s latest blog.

Read More Read More

Agile India 2022 – Systems Thinking for Happy Staff and Elated Customers

October 18, 2022 | Blog, Organisational Transformation, Software Consultancy

Agile India 2022 – Systems Thinking for Happy Staff and Elated Customers

Watch Simon Copsey’s talk from the Agile India Conference on “Systems Thinking for Happy Staff and Elated Customers.”

Read More Read More

Lean-Agile Delivery & Coaching Network and Digital Transformation Meetup

September 30, 2022 | Blog, Organisational Transformation, Software Consultancy

Lean-Agile Delivery & Coaching Network and Digital Transformation Meetup

Watch Simon Copsey’s talk from the Lean-Agile Delivery & Coaching Network and Digital Transformation Meetup on “Seeing Clearly in Complexity” where he explores the Current Reality Tree tool.

Read More Read More

Controlling Kafka Data Flows using Open Policy Agent

August 2, 2022 | Blog, Kafka

Controlling Kafka Data Flows using Open Policy Agent

Read Matt Farrow’s blog as he explores the potential for using Open Policy Agent to filter and mask data being sent to and read from Apache Kafka.

Read More Read More

HackCredo – An Internal OpenCredo Hackathon

July 5, 2022 | Blog, Culture

HackCredo – An Internal OpenCredo Hackathon

As we are passionate about using technology to solve problems, we are thrilled to share with you our internal competition, “HackCredo.” Read on to learn more about the competition, the groups, and the winners.

Read More Read More

Lunch & Learn: Learnings from Writing My Own Operating System from Scratch

June 30, 2022 | Blog, Culture

Lunch & Learn: Learnings from Writing My Own Operating System from Scratch

In this Lunch & Learn session, Peter Vegh advises on ‘Learnings from Writing my Own Operating System from Scratch’

Read More Read More

When Your Product Teams Should Aim to be Inefficient – Part 2

June 29, 2022 | Blog, Organisational Transformation, Software Consultancy

When Your Product Teams Should Aim to be Inefficient – Part 2

Many businesses advocate for efficiency, but this is not always the right goal.

In part one of this article, we explored how product teams can balance two important considerations – efficiency and effectiveness.

In this second part we will introduce the – often unexpected – implications of turning to technology to bring about efficiency and wider change, and the deeper considerations that must be addressed first.

Read More Read More

When Your Product Teams Should Aim to be Inefficient – Part 1

June 14, 2022 | Blog, Culture, White Paper

When Your Product Teams Should Aim to be Inefficient – Part 1

Many businesses advocate for efficiency, but this is not always the right goal. Part one of this article explores how product teams can balance two important considerations – efficiency and effectiveness. Part two builds on this idea, uncovering the non-obvious implications of using technology to bring about efficiency and wider change.

Read More Read More

Making Sense of Data with RDF* vs. LPG

January 31, 2022 | Blog, Data Engineering

Making Sense of Data with RDF* vs. LPG

There are two camps of Graph database, one side is RDF, where they are strict with their format, and somewhat limited for their extensibility. The other side is LPG, where they can define labels to the relationships. With its recent extension, RDF now allows users to add properties, thus becoming RDF*. In this blog, Ebru explores the structural and performance differences between LPG and RDF*.

Read More Read More

Running the Cloud from your Kubernetes Cluster

September 2, 2021 | Blog, Cloud, Kubernetes

Running the Cloud from your Kubernetes Cluster

In this blog, Stuart compares the new approach of deploying cloud resources as Kubernetes custom resources rather than the (now) typical approach using Terraform – or cloud specific: CloudFormation (AWS), Deployment Manager (GCP). He also identifies what resources are suitable for this approach and which ones are not.

Read More Read More

Kafka vs RabbitMQ: The Consumer-Driven Choice

July 20, 2021 | Blog, Data Engineering, Kafka

Kafka vs RabbitMQ: The Consumer-Driven Choice

Message and event-driven systems provide an array of benefits to organisations of all shapes and sizes. At their core, they help decouple producers and consumers so that each can work at their own pace without having to wait for the other – asynchronous processing at its best.

In fact, such systems enable a whole range of messaging patterns, offering varying levels of guarantees surrounding the processing and consumption options for clients. Take for example the publish/subscribe pattern, which enables one message to be broadcast and consumed by multiple consumers; or the competing consumer pattern, which enables a message to be processed once but with multiple concurrent consumers vying for the honour—essentially providing a way to distribute the load. The manner in which these patterns are actually realised however, depends a lot on the technology used, as each has its own approach and unique tradeoffs. 

In this article we will explore how this all applies to RabbitMQ and Apache Kafka, and how these two technologies differ, specifically from a message consumer’s perspective.

Read More Read More

Anthos – A Holistic Approach to your Hybrid Cloud initiative

February 17, 2021 | Blog, Cloud, Cloud Native, GCP, Open Source

Anthos – A Holistic Approach to your Hybrid Cloud initiative

Multi-cloud is rapidly becoming the cloud strategy of choice for enterprises looking to modernise their applications.

And the reason is simple – it gives them much more flexibility to host their workloads and data where it suits them best.

In this post, we focus on Google’s application modernisation solution Google Anthos and the role it can play in your cloud transformation strategy.

Read More Read More

Decision time with AWS Keyspaces

September 22, 2020 | AWS, Blog, Cassandra, Cloud, DevOps, Open Source

Decision time with AWS Keyspaces

With the upcoming Cassandra 4.0 release, there is a lot to look forward to. Most excitingly, and following a refreshing realignment of the Open Source community around Cassandra, the next release promises to focus on fundamentals: stability, repair, observability, performance and scaling.

We must set this against the fact that Cassandra ranks pretty highly in the Stack Overflow most dreaded databases list and the reality that Cassandra is expensive to configure, operate and maintain. Finding people who have the prerequisite skills to do so is challenging.

Read More Read More

Automation of complex IT systems

May 14, 2020 | Blog, DevOps

Automation of complex IT systems

At the time of this post, the UK is making steps to exit from an unprecedented lockdown measures for the Coronavirus. Much of the UK workforce are still making efforts to work-from-home with mainly key workers operating – at risk – in public. Many industries have shut down completely. Consequently, many businesses are reflecting on what happens next and how do we better mitigate future pandemic events?

Read More Read More

Kafka Connect – Source Connectors: A detailed guide to connecting to what you love.

July 30, 2019 | Blog, Kafka

Kafka Connect – Source Connectors: A detailed guide to connecting to what you love.

Writing your own Kafka source connectors with Kafka Connect. In this blog, Rufus takes you on a code walk, through the Gold Verified Venafi Connector while pointing out the common pitfalls

Read More Read More