Data sources can create, update and delete entities - to align with the remote data.
However, I'm investigating an issue where we are seeing entities being deleted from our catalogue - and it's unclear why the data source refresh has done this.
  • The entity is sourced from a file held in a github repo
  • The file has not been changed since the entity was first created
  • Manually "re-synching" the datasource re-creates the missing entity
  • Then, some "random" time later, the entity is deleted again
We can see that the entity is being created/deleted. And we can see "events" related to the data source. But none of this explains
why
the entity is being deleted - i.e. what data, from the source, has indicated that an entity deletion is appropriate.