So you acknowledge that the data exists, what you are scared of is being able to search it?
Usually that’s the insurmountable mountain. Data collection is easy. Formatting, storing and querying the data so you can actually get useful information out of it in a time efficient manner is the extremely hard part.
For a real world example, the organization I work at does quarterly audits of all of the field offices to make sure all of the field offices are in compliance, checking required document retention, gear, etc. and when an audit finds a requirement that is out of compliance they’re given a task with a deadline to complete said task to bring them back into compliance, and these tasks have visibility all the way up the chain of command to where even the C-levels are reviewing them regularly. I’ve been working a project recently to flag repeated failures of the same audit requirement for the same location and it’s highlighting that some field offices are not actually coming into compliance once these high visibility assigned tasks are completed which when I presented it to leadership it was a revelation just how many field offices are continuously out of compliance.
Point is, this data is being actively collected and formatted for easy access and there’s still glaring issues being missed due to the difficulty of finding these trends buried in the hundreds of pages of data being generated each quarter per field office
Uhhh I think you completely missed what I was saying. I was explaining that collecting data is easy, but actually making use of that data is really hard, and gave a real world example of a trend that should be obvious being buried in a mountain of data because there’s simply too much data to sift through
I gave you an out you entirely missed the point no one is talking about arbitrary amounts of arbitrary data the concerns are about things we say online being used against us in the real world.
Usually that’s the insurmountable mountain. Data collection is easy. Formatting, storing and querying the data so you can actually get useful information out of it in a time efficient manner is the extremely hard part.
For a real world example, the organization I work at does quarterly audits of all of the field offices to make sure all of the field offices are in compliance, checking required document retention, gear, etc. and when an audit finds a requirement that is out of compliance they’re given a task with a deadline to complete said task to bring them back into compliance, and these tasks have visibility all the way up the chain of command to where even the C-levels are reviewing them regularly. I’ve been working a project recently to flag repeated failures of the same audit requirement for the same location and it’s highlighting that some field offices are not actually coming into compliance once these high visibility assigned tasks are completed which when I presented it to leadership it was a revelation just how many field offices are continuously out of compliance.
Point is, this data is being actively collected and formatted for easy access and there’s still glaring issues being missed due to the difficulty of finding these trends buried in the hundreds of pages of data being generated each quarter per field office
Yea for sure more accountable reliable systems would be better than worse systems great point.
Uhhh I think you completely missed what I was saying. I was explaining that collecting data is easy, but actually making use of that data is really hard, and gave a real world example of a trend that should be obvious being buried in a mountain of data because there’s simply too much data to sift through
I gave you an out you entirely missed the point no one is talking about arbitrary amounts of arbitrary data the concerns are about things we say online being used against us in the real world.