So, you have decided, or have been instructed, to digitize all your records. Now what?

Where do you start? When do you start? What do you need to get the job done?

Lists

Just as with all complex projects, you are best to start with a simple list.

List all the records that need to be digitized; by type, by volume, by current format and by location. Review this list with your peers first (double-check that you haven’t missed anything) and then with management. Ask questions of management like:

 “Do you want me to digitize all of these records regardless of how long it takes and how much it costs?”

“When do you want me to start?”

“What is the budget?”

“What extra resources can I call on?”

“When do you want this project to complete?”

 “What are the metrics that will determine if I am successful?”

These are the core questions, the ones you must ask. Your dialog with your manager will probably result in many more questions and answers depending upon the unique circumstances of your organization. However, as long as you ask these core questions and get answers you are well on the road to producing a project plan.

Management Approval and Ownership

Your project will fail unless you have a senior manager ‘owning’ and supporting it. You need a friend in high places covering your back and authorizing your actions if you are going to be successful.

IT Support

Ask your senior manager to select and appoint a senior IT resource to be your IT point man. You are going to need IT support throughout the project and you need to know before you accept the project that someone senior will be appointed as your IT liaison person. Without readily accessible and committed (to the project) IT support you will fail.

The Project Plan

All project plans begin with multiple lists, for example: a list of all the tasks to be completed, a list of all the people who will work on the project, etc. Most importantly, you need to sort the tasks in order of prerequisites – i.e., we have to complete Task A before we can begin Task B. You also need to have sub-lists for each project employee listing their relevant expertise or capabilities; not everyone is equal. Some people can complete a particular task, some can’t. Some will take a day to complete a task others may take 3 days to complete the same task. You need to be well aware of capabilities before you assign tasks to individuals.

You need a good tool to document and manage your project plan because project plans are complex and dynamic. Never in the history of the world has there been a static project plan. About the last thing you want to change however, is the agreed (with your boss) completion date. Your main objective should always be to complete on time and your second objective should be to complete on budget. If you don’t have a project management system, try Microsoft Project, it’s low cost and relatively easy to use and it can do the job.

Human Resources

If your boss expects you to be responsible for the new records digitization project as well as your normal job you have the beginning of a big problem. If the boss expects you to complete the project without having any assistance your problem is probably terminal. You will need help probably both from within your organization and outside your organization because it is unlikely that you will have all the expertise you need within your organization.

Make sure that your agreement with your boss includes the additional human resources you need to be successful.

Software

It is unlikely that you will already have the software tools you need to be successful.  Basically, the software tools you need are required to capture, digitize, store and retrieve your records. Because records come in multiple formats you will need to ensure that you have the necessary software tools for each format of record to be captured. Refer to the initial list you compiled of records to be digitized by type, by volume, by current format and by location. Make sure that you have a software tool for each type of record. For example, scanning and indexing software to capture paper records.

Most importantly, make sure that you have a secure, scalable image and data repository to store and manage all of your digital records. This will usually be a structured database based on systems such as Oracle or SQL Server.

There is little point in digitizing your records if they can’t be centrally accessed, managed, searched and retrieved.

Hardware

Software requires appropriate hardware. Make sure that you have permission and budget to acquire the prerequisite hardware such as servers, workstations, scanners, etc. You will probably need help from your IT department in defining exactly what is required.

Management

Your job is to manage not facilitate. As project manager, you accept responsibly for both success and failure. Your job is to make things happen. Your job is to continually review progress, to identify and remove roadblocks. Your job is to keep all project staff focussed and on mission. It is a lot of work and a lot of effort and sometimes, a lot of frustration. You have to be prepared to regularly consult with both project staff and users. You have to be prepared to make tough decisions. You have to be committed and focussed on success but not stubborn. Sometimes it is better to give a little to win a lot. Always focus on the end result, completing the digitization project on time and on budget.

Success or Failure

There are absolutely no good technical reasons for failure. The expertise, hardware and software required to digitize all of your records is readily available from a plethora of vendors. Furthermore, there are plenty of examples both good and bad in the market for you to learn from. There is no record that can’t be digitized. The only difference between success and failure is you and your initiative, creativity and commitment.

Why is it so hard?

Let’s begin with a couple of borrowed quotes:

“Digital transformation is the profound and accelerating transformation of business activities, processes, competencies and models to fully leverage the changes and opportunities of digital technologies and their impact across society in a strategic and prioritized way, with present and future shifts in mind.” Or, put more simply:

“Digital transformation — the use of technology to radically improve performance or reach of enterprises.”

Having been involved in the digital revolution since the early 1980s (Office Automation) and through the 1990s (the Paperless Office) and now into the 21^st Century (Enterprise Content Management) I have watched and participated as thousands of clients have, with all good intentions, tried to transform their enterprises into digitally-empowered entities.

Whereas there are many aspects and functions of any enterprise to transform, the high-level aspects are the customer experience, business processes and business models.

As a builder and purveyor of Enterprise Content Management Solutions, my involvement has usually been in the area of business processes, most specifically, Workflow, Electronic Records and Document Management (EDRMS), Email Management and Document Imaging. These are of course, now very old-fashioned terms and likely to be usurped in the near future but for now they are terms we have to work with.

To the layman, it should be a piece of cake. “Work only with electronic documents and get rid of all paper.” Of course, it would be that simple if we lived in a vacuum but we don’t. We have to interact with the world outside. We have to deal with other organizations, with local government and state government and federal government and we all have to meet a plethora of rules and regulations, many still mandating paper. There is also a huge number of people who still prefer to work with paper. Even today, there is a lot of opposition to the digitization of records.

Thirty years ago we struggled because, by today’s standards, the technology was massively expensive and patently inadequate for the task. Someone may well say the same thing about today’s technology 30 years into the future but from my viewpoint, we now have all the technology we need at affordable prices to digitally transform any process.

Yet, when I talk to clients today and examine their operations I see many of the problems I saw 30 years ago. I see veritable mountains of paper, I see scores of manual processes crying out for automation. For the record, we still receive as many requests for physical records management systems (i.e., managing paper and files and boxes) as we do for electronic records management solutions. Our clients still have millions of boxes of old records in offsite storage warehouses. Our clients are still spending millions and millions of dollars storing paper they will never look at again. Our clients are still struggling to obtain the imprimatur of someone senior enough to automate the capture of all emails.

I still see organizations spending years and vast amounts of money trying to implement records classification and retention systems designed for the paper-bound world of the 19^th century. Virtually, “Doing it this way because we have always done it this way.”

I see the core problem as blind adherence to the cultural heritage of paper and filing. These ancient customs were primarily focused on ‘filing’ almost to the extent of an obsession. Unfortunately, most of today’s records management systems are also obsessed with filing when they should be obsessed with finding, with ‘discovery’.

It is the obsession with filing that most impedes the digitization of records in most enterprises.

Remove this fixation on filing and suddenly digital transformation becomes a whole lot easier, less costly and significantly less intrusive for the ordinary worker who just wants to quickly search for and locate everything he or she needs to get the job done (or work process completed).

It reminds me of a definition I wrote for Knowledge Management back in 1995:

“A knowledge management system provides the user with the explicit information required, in exactly the form specified at precisely the time the user needs it.”

Surely, isn’t this still what every organization needs?

Paper is great for taking notes, for doodling, for sketching, for napkins, for hand towels, for prints, for novels, etc. It is great for a great many things, it is in fact a wonderful invention but it should not be used for records. It should not be filed away, it should not be stored in boxes on dusty shelves in huge warehouses. It should not consume a large part of your operational budget every year. You have better things to spend your money on.

If you truly want to digitize your records then lose the obsession with filing and outlaw paper records. Be brave, be bold, be authoritative.

Focus entirely on dealing with data, information and knowledge – none of which require paper.

It can’t happen overnight but you have to begin as you intend to go forward. Start by telling your suppliers you will no longer accept paper records. Tell them they will no longer receive paper from you. Tell them everything must be in a digital form. Tell your clients you will now only communicate in a digital form. Concentrate on getting the very best out of digital tools like Office365 and email. Find ways to capture every digital record either on creation or receipt. Implement a secure, scalable image and data repository. Hire a corporate Information Manager, not a Corporate Records Manager (who will be obsessed with filing). Bite the bullet and make it happen.

In time, get rid of printers and photocopiers; all you should need for the transition from paper is scanners. Remove the temptation to print anything. Shut your ears to the complaints; there is no point in arguing with someone who isn’t listening.

Of course, the real secret to successfully digitally transforming a process or organization isn’t technology, it is resolve and leadership. If you have failed, it isn’t because you didn’t have the tools, it is because you lacked the leadership and resolve and determination required.

Take a break, have a coffee, contemplate and then tackle it again. With enough resolve and determination, you will get there. Sleep more peacefully at night knowing you have saved millions of trees.

“43 Reasons why Managing Records in-Place may not be good enough”

Enterprise Content Management is a moving target, constantly evolving with new challenges and new paradigms. For example, how do we filter out only relevant information from social media? How do we avoid capturing personal data and being culpable under privacy laws? How do we capture all emails containing sexism, racism and bullying without being guilty of an invasion of privacy of the individual? How do we meet all of our compliance obligations when our staff are spread across multiple states/counties/provinces and multiple countries with different legislation and compliance requirements? All weighty challenges for the modern Knowledge Manager or CIO.

Another interesting challenge for Knowledge Managers and CIOs is the newer document management paradigm of being asked to manage all content without a single central repository. That is, to be responsible for all content across a myriad of locations controlled by a myriad of applications and a myriad of departments/organizations and people. Back when I was an employee and not an employer, my tough (ex-military) manager in Blue Bell, PA would just bang his fist on his desk and say, “Goddam Frank, just do it!” That was always a signal for me to get creative.

However, try as I may, I am finding it nigh on impossible to get creative enough to work out how I could effectively and reliably manage all content across an enterprise without a single central repository.

In multiple-repository systems we find multiple document stores; local files, network file shares, local data bases, multiple file servers, multiple copies of SharePoint and multiple Cloud repositories like Dropbox, Box, iCloud, Google Cloud Storage and other hosted document storage. The CIO may proudly claim to manage multiple information silos but what he or she really has is a laissez faire document management ecosystem that may well be centrally monitored (hopefully) but is most certainly not centrally managed.

In the multiple silo model the documents in our multiple locations are ‘managed’ by multiple people and multiple applications (e.g., SharePoint, Google Docs, etc.). We may have implemented another layer of software above all these diverse applications trying to keep up with what is happening but If I am just ‘watching’ then I don’t have an inviolate copy and I don’t have any control over what happens to the document. I am unable to enforce any standards. There is no ‘standard’ central control over versioning or retention and no control over the document life cycle or chain of evidence.

For example, you wouldn’t know if the document had since been moved to a different location that you are not monitoring. You wouldn’t know if it had been deleted. You wouldn’t know its relationship to other documents and processes in other silos. You wouldn’t know its context in your enterprise and therefore you wouldn’t know how relevant this document was. The important distinction is that under the multiple silo model you are ‘watching’ not managing; other software is managing the life-cycle and disposition of the document.

All you really know is that at a certain point in time a document existed and what its properties were at that time (e.g., historical ‘natural’ Metadata such as original filename, author, date created, etc.). However, you have no contextual Metadata, no transactional Metadata, no common indexing and no common Business Classification System. In this case, you don’t have a document management system, you have a laissez faire document management ecosystem, an assortment of independently ‘managed’ information silos. Most importantly, you are not able to link documents to business processes that transcend organizational structures and silos.

Sure, SharePoint and Cloud silos make collaboration easier but at what cost? What can’t we do with this multi-silo ecosystem? Why doesn’t this solution meet the best-practice objectives of a document management system? What are the major areas where it falls short? How does the proliferation of multiple silos and content repositories affect us? What are our risks? Here is my assessment of the major shortfalls of this paradigm.

 We are unable to:

1.    extract the critical insights that enterprise information should provide

2.    define all the relationships that link documents to enterprise business processes

3.    find the right information at the right time

4.    provide a single access point for all content

5.    Implement an effective, consistent enterprise-wide document security system

6.    effectively protect against natural or man-made disasters

7.    produce evidence-standard documents

8.    minimize document handling costs

9.    guarantee the integrity of a document

10.guarantee that a document is in fact the most recent version

11.guarantee that a document is not an older copy

12.minimize duplicate and redundant information

13.meet critical compliance targets like Sarbanes-Oxley Act (SOX) and the HIPAA

14.create secure, searchable archives for digital content

15.effectively secure all documents against loss

16.implement common enterprise version control

17.facilitate enterprise collaboration

18.Improve timeliness

19.manage enterprise document security and control

20.manage smaller and more reliable backups

21.achieve the lowest possible document management and archiving costs

22.deliver the best possible knowledge management access and search

23.guarantee consistent content

24.optimize management and executive time

25.standardize the types of documents and other content can be created within an organization.

26.define common use template to use for each type of document.

27.standardize the Metadata required for each type of document.

28.standardize where to store a document at each stage of its life cycle.

29.control access to a document at each stage of its life cycle.

30.move documents within the organization as team members contribute to the documents' creation, review, approval, publication, and disposition.

31.implement a common set of policies that apply to documents so that document-related actions are audited, documents are retained or disposed of properly, and content that is important to the organization is protected.

32.manage when and if a document has to be converted from one format to another as it moves through the stages of its life cycle.

33.guarantee that all documents are treated as corporate records, that common retention policies are applied determining which documents must be retained according to legal requirements and corporate guidelines.

34.guarantee enterprise-wide Regulatory compliance

35.produce an enterprise-wide audit trail

36.share information across departmental and/or silo boundaries

37.centrally manage the security access to documents/information across different areas of the organization.

38.consistently classify documents as each repository may be used by a different department and be classified differently.  

39.identify duplicates based on document name.

40.easily find things based on metadata, as it wouldn’t be common across repositories.

41.control access via AD single sign on

42.access all enterprise documents using a single license.

          43.centrally audit access and changes to metadata.

What are your risks?  Your risks are huge!

 

 

 

 

 

For many, many years records managers and records consultants have talked about how to give records management more visibility, more focus and naturally, more money.

To help address this need I was asked to write a paper in 2007 called “Changing Records Management from a Cost-Centre to a Profit-Centre” You can read it here at this link:

At that time it was felt that if we could change the records management function to being a profit-centre then we would certainly and rapidly move up the food chain. Whereas I don’t know if anyone has actually accomplished the change from cost-centre to profit-centre, I am pretty sure it hasn’t been a common occurrence just as I am sure that records management hasn’t moved much up the food chain.

It may well be that if we want to accomplish our multiple goals of more visibility, more focus and more money that all we really need to do is start thinking of what we do as just another aspect of Business Process Management. This shouldn’t be too difficult because that is exactly what records and document management is.

In the ‘old’ days when I was a young systems analyst I was often asked to complete a paper flow analysis. This was in the days before office automation, PCs, networks and servers. The big jobs like payroll and inventory management were all done on the mainframe and progressive managers were already looking for other processes to automate or at least improve, mainly to lower costs and improve productivity.

My first success was an improved accounts payable system at Australian Iron & Steel at around 1968 (yes I know, I can’t really be that old). No automation was involved, just significantly improved and shortened paper flows and the deletion of many redundant processes most done because “We have always done it like this”.

The value I brought to the equation was a strong desire to prove myself plus an outside-the-square view of everything. I was never satisfied with the status-quo and I asked “Why?” literally thousands of times. With hindsight and many years of consulting under my belt, I now realize that “Why?” was and is my most powerful tool.

This brings me to the crux of the matter, why don’t I hear “Why?” much more often in the records and document management business today? Sure, consultants will come in and ask “Why?” to try to find out if a particular process is still appropriate. However, I am also sure that the last thing a consultant wants to hear as a response is, “Because we have always done it that way”.

This response means staff are working like robots and not thinking about what they are doing every day. They are not exercising their brain power and are not questioning how the company uses up their valuable time. This is dangerous because if you aren’t adding value then you don’t have any value to your organization.

Would the same employee continue to drive for 10 miles to a mall if a new mall was built just 1 mile away? Probably not given that all things were equal (e.g., same shops). So why doesn’t that same person look for a faster, more productive way to complete their tasks at work? The answer is usually because it has always been done that way and that is what the Policy and Procedures manual dictates. It is also probably the way that the current quality certification says it should be done and documented, with paper of course.

The core problem is that very few people question current processes and very few people dare to question the Policy and Procedure manual and even fewer would dare question the current quality or certification manual. Unfortunately, many people also hide behind the status quo; it is a reason or excuse for not turning their brains on, for not exercising their intellect. This also means that they are adding little value to their organization.

There is a lovely old expression that goes along the lines of “You can’t see the forest for the trees”.

All human beings are guilty of this at one time or another. We get so wrapped up in what we are doing (day in and day out) that we don’t take the time to stop and critically examine the processes that are using up our lives. Repeat, using up our lives.

A major stumbling block is that there seems to be a common belief that records and document management is somehow outside of the normal practices of a business; that it is different and special. This has been fostered by a long time process of records management segregation.

By trying so hard to get the rest of the business community to focus on records management with standards and legislation and the like, we have effectively segregated records management from normal business operational procedures. In most cases, we have created a painful little monster that most people don’t like and resent but put up with because of the vague threat of punitive legislation or not having a particular box ticked and failing an audit. This sounds very much like we are addicted to using the stick instead of the carrot. As any donkey owner will tell you; it doesn’t work.

What I am saying is that although well-meaning, all the standards and legislation we have helped create over the years have made the problem worse not better. We have set ourselves apart and demanded special treatment and special processes not aligned with the core business objectives of the organization we work for.

The solution is to start anew with a new paradigm. The first principle of which is that records and document management is an essential and integrated set of business processes in any organization. Most importantly, governed by the specific needs of each organization, not some otherworld standard. Perfectly aligned with the business objectives of the organization, not some obscure standard that no one really understands or even follows. Blasphemy you say?

No, I am not saying we shouldn’t have a retention schedule and no, I am not saying we shouldn’t implement policy and procedures to govern how we handle information. Nor am I saying we can afford to ignore some piece of legislation that threatens punitive action and fines if we don’t adhere to its dictates.

In a better world we wouldn’t have this annoying plethora of standards, legislation and certifications that overcomplicate, overlap and confuse. Unfortunately, as long as we have multiple layers of government and thousands or millions of politicians and bureaucrats who judge themselves on how much legislation they can impose on us, we have a battle just getting though every day without breaking some rule or another.

It therefore behoves us to be judicious and do our best to make sure we protect our organization. However, our main objective must always be to ensure that everything we do aligns perfectly with the core business objectives of our organization. This has to be our first priority. We have to see records management as just another set of fully integrated, fully aligned business processes. The company has to come first; we are its servant. If it doesn’t succeed then we don’t succeed.

Let me assure you that if you make a concerted effort to consult with senior management and say “I need to make sure that all of our records and document management processes are perfectly aligned with your current and future plans and objectives. Can you please explain to me what you would like us to achieve?” that records management will get the visibility, focus and money it deserves as a real contributor to the company’s overall goals.

 

Don’t segregate, integrate!

 

More than thirty years after the advent of email as a convenient and fast means of business to business communication most organizations still don’t have an effective way to analyze, monitor, select, capture and classify emails. If your organization does, then you are the exception.

This means most businesses don’t come even close to meeting the requirements of any compliance legislation that applies to their business. Nor do they even come close to managing real corporate risk.

It also means that most businesses don’t effectively guard against sexism, racism, obscenity, theft and bullying in their email system.

Is this a case of ‘heads in the sand’ or is the problem seen as just too hard? Maybe, senior management doesn’t really see unmanaged and unmonitored emails as a problem. Well, at least until the first court case.

In my experience, many organizations think they have a solution but in reality, they don’t; at least not a one hundred-percent solution. In the case of email management, ‘good enough’ is certainly not good enough. It only takes one bad email to slip through the cracks to bring the whole house down.

In many examples, organizations rely on end users to monitor, manage and police email. The problem with this model is that end users are human and typically exhibit all the strengths and weaknesses of humans. In this case, we are more concerned with the failings. As humans we are not always on top of our game; we have good days and we have bad days. We get distracted, we are prejudiced, we are sometimes lazy, we are sometimes careless and for a small number, we are sometimes outright dishonest.

Human beings will never produce a one-hundred-percent consistent result; that is not in our nature. Maybe when AI gets to the stage that we can all be ‘upgraded’ to cyborgs this will change, but I seriously doubt it. As long as there is any trace of humanity we will still be lovingly unreliable and inconsistent entities.

You don’t have a one hundred-percent reliable system if you don’t control and standardize all the inputs. Instead, you have a form of ‘managed chaos’ and inconsistent and unreliable results. You will also probably have a false sense of security, “Sure, we are managing all emails (well, kind of).”

I have been a proponent of the fully-automatic, server-centric paradigm for email management for many years and still promote it as the only one hundred-percent reliable way to effectively and consistently manage all incoming and outgoing emails. It is also the only way to manage risk effectively.

To be one hundred-percent sure you must have a one hundred-percent consistent paradigm. That is, a common set of rules that all emails are judged against plus a common set of processes to apply after an email has been ‘judged’.

Following are some example of what our fully-automatic, rules-driven email management system should be doing 24/7:

• Is the email of a personal nature and harmless? If so, it can be ignored, there is no reason to capture and classify it.
• Is the email all about business? If so, it needs to be captured and correctly classified within our corporate store.
• Does the email contain expletives or sexual references? If so, it needs to be captured, quarantined by our security system and referred to a responsible officer for further examination and possible action.
• Does the email contain references to corporate IP or classified material? If so, it needs to be captured, quarantined by our security system and referred to a responsible officer for further examination and possible action.
• Is the email about business and does it require some action or response? If so, it needs to be captured, correctly classified within our corporate store and appropriate workflow initiated.
• Is the email from a senior executive, about business and does it require some action or response with appropriate access controls applied? If so, it needs to be captured, correctly classified within our corporate store with appropriate security and access rights assigned and appropriate workflow initiated.

We produced our first fully-automatic, rules-driven email managements system in 1994. By today’s standards the technology was primitive but it worked and we used it within our business to demonstrate to our customers and partners how it could function in the real world. We called that product GEM for ‘GMB’s Email Management’ system. 

GEM has been redesigned and rewritten multiple times since so as to utilize the latest technology and tools. We still call it GEM even though our company is now called Knowledgeone Corporation, not GMB; the name works for us and our customers and we see no need to change it. It is after all, a ‘gem’ of a product.

We have used each and every version of GEM since 1994 within our company (we are the primary Beta test site) to automatically analyze all incoming and outgoing emails and to store and classify captured emails in our corporate store based on the RecFind 6 relational database. I can’t imagine running my business without GEM and I don’t understand how other organizations can exist without GEM, but they do albeit, taking huge risks.

The latest version of GEM, 2.7.1, is a major upgrade and involves a significant change in the way we connect to email servers of any type (e.g., Exchange, Office 365, GroupWise, Notes, etc.). We have standardized and simplified the interface to the email server using IMAP and converted our Agents to Windows Services to make the installation and management of GEM as easy as possible for your IT staff.

We have also improved the Rules engine to make it as easy as possible to define all the rules you need to manage your emails.

Because we have 21 years’ experience installing, configuring and using GEM in a real-world production example we also have the world’s most experienced GEM consultants to assist our customers.

How GEM integrates with any other EDRMS

GEM is designed to use the RecFind 6 relational database as its image & data repository. However, we provide several options for integrating to any other EDRMS such that the other EDRMS can search for and access emails (and the associated Metadata) captured by GEM. The four main methods, in order of ease-of-use are:

1. Capturing encapsulated XML records produced by GEM;
2. Using the RecFind 6 Mini API;
3. Using the RecFind 6 SharePoint Integration Module (for customers using SharePoint as their EDRMS); and
4. Using the RecFind 6 SDK

Please contact Support at Knowledgeone Corp for more information on the above methods.

 

We have a large number of records and document management customers using our product RecFind 6 and with new customers the question always arises about how to best organize information in the RecFind 6 database. As the Metadata and business processes in RecFind 6 are 100% configurable, every customer ends up with a unique configuration.

Some records managers want the shared drives structure replicated in the database. Some want everything filed under a strict hierarchical classification system or Taxonomy. Some customers want the whole process simplified so end users clearly know where to file stuff and where to find stuff. Different managers in a single customer site will often disagree about how the information should be managed. Usually, the IT manager disagrees with the records manager and it is up to us to come up with an agreed and workable compromise; no easy task! There is no “one size fits all” paradigm here. We have grown to accept these discussions as part of every new installation.

Whereas I fully support the principles behind most EDRMS standards as espoused and recommended or even mandated by records management consultants I also find myself agreeing with most end users who just want the whole process simplified and expressed in natural language, not as an arcane, complex, inconsistent and difficult to navigate hierarchical classification system.

To wit, the way you classify information should not dictate how you store, manage and retrieve information.

I have written a paper of this exact subject and although it was in 2009 it is still 100% relevant. Please see this link Do You Really Need a Taxonomy? You don’t have to agree with me but please try to understand the message. End users want easy, fast access, not time-consuming complexity.

Maybe I should begin by telling you how we solve the problem at Knowledgeone Corporation and manage our emails, electronic documents and shared drives with a hybrid system. That is, a combination of RecFind 6 and shared drives. This is also a model we regularly recommend to our customers as an acceptable compromise; one that is simple to implement and one that always works.

I am obviously a big fan of making information as easy as possible to capture and as easy as possible to retrieve. This is especially important to the long-suffering end-user class who have no interest in becoming part-time records managers and who simply won’t use a system if it is too difficult to use and too time-consuming.

End users want direct access to information in the easiest and most timely fashion possible, they do not want to go through a third party or ‘information broker’. This means we need to have both a simple search system as well as a security system that ensures people only see what they are supposed to see.

And of course, the biggest problem with complex, hierarchical classification systems is that no two people file the same way and even a single user will often file things differently over time. This in itself makes the act of finding something by browsing through a classification hierarchy a hit and miss affair.

At Knowledgeone Corporation, we implemented a hybrid model that uses a simply structured shared drive resource plus automated tools to ensure everything that should be captured is captured. This approach is also all about separating the functionality of the Authoring packages (e.g., Word, Excel, Outlook, etc.) from the functionality of the EDRMS. They have different roles to play.

Let’s dispense with the notion that shared drives are evil just as we should dispense with the notion that paper is evil. Each has a part to play in a well management information management system

We use our product GEM to automatically capture all work related emails and we use our product RecCapture to automatically capture all work-related electronic documents from our shared drives. We all use a common shared drive structure to write and store our original electronic documents. Note that we do not use the feature in the RecFind 6 Button to force all ‘Saves’ into RecFind 6. We have this feature because the industry dictates it should be there but it is not popular and most customers never turn it on. Not everything you write should go into RecFind 6 and not everything you write is ready to go into RecFind 6 (though we do have a special ‘draft’ type for those customers that want drafts stored in RecFind 6).

We don’t use what you would call a formal taxonomy, we use what I call a ‘natural’ classification system. For us this means a classification system that perfectly reflects our business practices, processes and vocabulary. In our case, we are customer-centric so everything (apart from a little administrative and supplier stuff) is organized in customer or prospect folders and the lower levels are minimal, being things like Correspondence, Quotes and Orders.

Our RecFind 6 database is mostly based on customer and prospect files; it is our CRM. Customers and prospective customers are our core business just as members and cases are the core business of unions. Every industry has a core business and in my mind this should always be reflected in the classification system used so that it perfectly aligns with the work practices and processes and ‘language’ of most staff. Whenever I consult to a new organization I always try to first determine its core business and its natural language and then design the implementation around these.

We also use RecFind 6 to run our business so it is also our asset management system, our help desk and incident system, our project management system and our R&D development system. For these applications and others that we have implemented in RecFind 6, we have nothing outside of RecFind 6 to capture because all relevant information (e.g., customer support calls, details of meetings, phone calls, quotes, orders, annual leave request, etc.) are entered directly into RecFind 6 by our staff or captured automatically. RecFind 6 is our company repository and the source of all knowledge for my staff.

Because we are customer centric I need to be able to see everything about any customer or prospect in one place. For us this means centralizing on the Entity record (the Entity table is where we store the basic information on each customer or prospect). As RecFind 6 is a relational database we then store all related information in linked tables, all linked to and accessible from the Entity record with a single click.

In our RecFind 6 system, every piece of information I need to refer to is just one-click away once I view the entity record. I can also find any customer’s record instantly in RecFind 6 just by entering the customer number or a part of the organization name. Once I select the customer record, everything thing else I need to know is just one-click away and all links are viewable in a single screen. We are a customer-centric business and our RecFind 6 database is therefore organized as customer centric.

In practice, if someone at Knowledgeone Corporation wants to find something they always look first in RecFind 6 because it is a lot easier and faster than trying to search the shared drives or Outlook. Because we use automated tools (GEM and RecCapture) we are confident that everything that should be captured is captured. We don’t rely on our already too busy staff to remember to capture every important email or electronic document; it is done for them. All they have to do is search and create. Plus most of our information is stored behind customer/prospect/partner numbers in the Entity table so all information is both easy to browse and search (Text, Metadata, BOOLEAN, Saved Searches, etc.).

As a backup, every staff member has the Button installed (in Word, Excel, PowerPoint and Adobe Professional) but they rarely use it.

We have a security system configured around our management structure that works fine for us. As a Director for example, most of the stuff I save is with a basic security code (e.g., a letter to a customer) because everyone needs to be able to see it. However, as a Director I also have the right to save things with higher levels of security, e.g., Manager, Director, where appropriate with restricted access. Like all good security systems, it is simple but effective. I am not a fan of overcomplicating anything.

Our searching is also structured the same way. We have configured RecFind 6 to add the objects we need to search on as menu items in the search function just as we would do for any customer. We therefore have a Metadata search menu of Attachments (electronic documents, emails and images), Entities (Customers, Prospects, Partners and Suppliers), People, Incidents, Bugs, Quotes, Invoices, Timesheets, Support agreements, etc. We repeat this with Boolean searches. We make it as easy as possible and as logical as possible so our staff can find anything as fast as possible. After all, I am paying their salaries so I want them to be as productive as possible.

Most importantly, we provide multiple entry-points for searches. I can for example search directly for emails with a Metadata search, searching by a combination of Sender, Recipient, Date, Subject, etc. Alternatively, I can search for customer emails from within the Entity record just by clicking on a single link for all attachments for that customer. We give our staff multiple options just as we give our customers multiple options.

You can search on any field and different classes of users can have different Metadata to both view and search on. The security system determines what each class of user (security group) can both see and then do with the information they can see. That is, the security system determines what tables and fields (and electronic documents and emails) you can see and then what methods (Add, Modify, Clone, Delete, Search, Print, etc.) you can use. Each security group sees only what it needs to see and has only the functionality it needs to get the job done

Because the system is flexible, the records manager for example could choose to search for emails on the way they were classified (say a 3 level hierarchy) but end users could choose to search using a natural selection of Metadata fields such as Sender, Recipient, Subject, Content, Date or ranges of these fields combined in either a Metadata or BOOLEAN or (making it easy for end users) Saved search.

Its horses for courses!

Following the above hybrid approach also means that you can still implement and manage all the recordkeeping principles such as retention and disposal schedules, location tracking, auditing, etc.

My point is that it is possible to meet the needs of all classes of users without frustrating any group.  It just requires a hybrid approach and the configuration of the system to suit each class of user.

Making everyone happy is a lot better than making some people happy and some people unhappy. Why would you do this if you had a choice?

 

 

By nature I am and have always been a sequencer and an overlapper. It comes naturally to me. It is how I process everyday events. For example, in the morning when making a pot of tea I first fill up the jug and turn it on to boil before emptying and cleaning the teapot. This is because I want the two tasks to overlap for maximum efficiency. If I emptied and cleaned the teapot first before filling up the jug and turning it on, the elapsed time required to make a pot of tea would be longer and therefore inefficient. With my method I save time because the total elapsed time to make a pot of tea is how long it takes to fill the jug and get it to boil. I correctly sequence and overlap the two events to be more productive. It also helps me to get to work on time.

Here is another simple example. Have you ever been in a restaurant and watched with frustration as the waiter brought out meals and then returned to the kitchen without picking up your dirty dishes? Then watch in frustration again as the waiter comes out to pick up dirty dishes but leaves someone’s lunch at the kitchen counter getting cold? Why doesn’t the waiter pick up dirty dishes, or take your order, on the way back to the kitchen? Life, business and government is full of such everyday examples of non-overlapping, poorly sequenced processes all resulting in lower productivity and higher costs for everyone.

The worst example of all is when employees are allowed to tightly redefine their jobs concentrating more on “this is what I don’t do” instead of “this is what I do”. For these employees, the terms ‘multi-skilling’ and ‘multi-tasking’ are anathema. I envision them standing within a tiny, tight circle where anything outside of that circle is not their responsibility. We may as well brick them up inside a chimney. These are not the kind of employees or practices I want in my business or our public service or our government for that matter. Unfortunately, these are exactly the kind of ant-productivity practices we find throughout our public sector and our government. As most of us are already more than well aware, the problem is more than endemic; it is systemic and probably not fixable short of a revolution. It is no secret why our taxes are so high and getting higher all the time.

Many years ago when I was a trainee programmer I learnt all about overlap while being trained at IBM. The patient instructor made the point that computers only seem to do multiple things at the same time. In fact, the architecture of computer processing at that time meant a computer could only process one command at a time but in making use of overlap and time-sharing it appeared as if it was doing many things at once. For example, the IBM 360 processor would issue an I/O command to a channel to go off and read a record from a disk drive. Relatively speaking, this took an enormity of time because disks were so slow compared to the CPU. So instead of waiting for the channel to complete the I/O request the processor would process other work all the time waiting for the channel to interrupt it and say “I am finished, here is the data you asked for”. So the computer appeared to be doing multiple tasks at once because it correctly sequenced the tasks it had to perform and took full advantage of overlap. Therein lies a lesson for all of us.

When faced with a list of tasks to perform first think about the opportunities for overlap. Then sequence the tasks to take maximum advantage of overlap.  

All it requires is the desire to work smarter, a little thought and a sense of pleasure in making best use of the limited time life allows us all.

In my role as a designer of computer software I always try to take advantage of sequencing and overlap. In my business, the two terms most used when implementing this approach are asynchronous events and multi-threading. These two techniques should always be applied when a list of tasks to be performed is not sequential. That is, they don’t have to be completed one after the other in a strict sequence. We take advantage of the fact that some tasks are independent and therefore can be processed at the same time we process other tasks. We do this in various ways but usually by defining them as asynchronous events and by utilizing a form of multi-tasking or multi-threading (starting two or more events at the same time). Computers aren’t smart (at least not yet) and they rely totally on human programmers to make them behave in an efficient and ‘smart’ way. Computer programmers who don’t understand sequencing and overlap can write very bad and very slow programs even to the extent of making very fast computers look very slow. Then, they waste everyone’s time and become major contributors to the anti-productivity movement.

There is an enormous amount of money being invested today in the science of longevity; in trying to find ways to make it possible for people to live longer lives. When the solution becomes available it won’t be cheap and it won’t be available to ordinary people like you and me. It will initially only be available to the elite and to the very rich. However, don’t despair; there is a low-cost way to double the amount of time you have to enjoy life. An easy and available now way to double your life span.

All you have to do is be aware of the possibilities of sequencing and overlap in your life and then work to take advantage of them. If you reduce the amount of time you take to do ‘work’ every day by fifty, forty, thirty or even twenty-percent you are adding years to the time you have to live and enjoy life. It is the easiest and lowest cost way to increase your effective life span.

For example, don’t try to impress your boss by working longer hours; arriving first and leaving last (as my generation did). Instead, impress your boss with a proposal whereby you do more work in fewer hours. You of course need to quantify your proposal and add in some metrics so your increased productivity can be measured and proven.

Please don’t waste your time and your effective life span by pondering ways to avoid work; instead, utilize those same cognitive processes to work out how to complete your assigned work in the fastest way possible. Approach every project looking for ways to better sequence tasks and take advantage of overlap. Make it a game; enjoy it.

I was once told that the average pattern of a human life is eight-hours work, eight-hours sleep and eight-hours play. Of course, with commuting, it is really now more like eight-hours sleep, ten-hours work and six-hours play. Let’s try and double those play hours.

As I am fond of saying, it isn’t rocket science. It is just common sense, a very simple and achievable way to significantly increase your effective life span; the time available to you to enjoy life. Give yourself twice as much time to enjoy life and in doing so, live twice as long. 

Increased productivity doesn’t just provide benefits to the economy; it can also provide very substantial personal benefits. Why don’t you give it a try?

Because we are a software vendor that builds and markets a range of Enterprise Content Management tools under the RecFind 6 banner I have often been asked, “What is the absolute easiest and lowest cost way to meet all compliance requirements?”

I usually respond with a well-considered and ‘traditional’ response that includes information about Business Classification Systems, UI design, Retention Schedules, etc., etc. The solution proposed would also require a significant degree of consulting so that we aware entirely conversant with the customer’s requirements and business practices and also involve a significant amount of end user training.

This is what the customer expects and it falls in line with the traditional, professional approach.

However, the final solution is rarely ‘easy’ or ‘low-cost’ primarily because it has followed the traditional approach. The more we ask questions and consult and the more people we speak to the more complex the solution becomes. This is normal because we end up trying to configure a solution to meet hundreds or thousands of variables.

There is an easier and lower cost way but I fear that very few of my customers would ever consider it because it requires them to disregard everything they have ever learned about rolling out an EDRMS. We have tried proposing it a few times but never with success. It usually gets shot down by the external consultant or the internal records management professional or both.

It doesn’t require a BCS or a Taxonomy and it doesn’t require a complex Retention Schedule and it doesn’t require significant consulting or significant end-user training. Records Management professionals will surely hate it as a ‘career-ending’ trend. It does require an open mind, the ability to think laterally and a willingness to redefine both the problem and the solution.

It only has three requirements:

1. Know what electronic documents and emails you don’t want to capture;
2. Provide a powerful but easy-to-use search that allows anyone to find anything instantly; and
3. Employ a risk-management approach to retention and select a single retention date (e.g., 7 or 20 years).

Fundamental to the success of this non-conformist solution is the acceptance that computers and storage are dirt-cheap compared to human time. If your IT manager or CIO still agonizes and complains about how much disk space you use up for emails and electronic documents then this is definitely not the solution for you. Your IT hierarchy is still living in the long-gone past when computers and disk were expensive and people were cheap (by comparison).

However, if you have practical, sensible IT people then the approach is worth considering especially if your organization has a long history of failing to digitize its records and automate its processes. That is, you have tried at least once to roll out an organization-wide EDRMS and have failed and/or blown the budget. The word ‘pilot’ probably appears often in your company history usually prefixed by the adjective ‘failed’. Don’t feel too bad, most pilots are initiated because management lacks conviction. They are therefore destined to fail.

We have the tools required to implement such a solution but I won’t go into detail about them now. This is a concept paper, not a detailed instruction manual. If you are interested in the concept please contact me and I can then elaborate.

So, if you really do want to rollout a successful EDRMS and do it in the fastest and least disruptive and lowest cost way possible then please write to me and pose your questions.

For the doubters, this is the same way we manage our electronic documents and emails at Knowledgeone Corporation and we have done so for many years. We use our own software; apart from a couple of accounting packages we run our whole company with the RecFind 6 Product Suite and totally automate the capture of all electronic documents and emails. All my staff have to know is how to search and yes, they can find anything in seconds even after 31 years of operation and a very, very large database.

It is not difficult, it is not ‘expensive’, it does not require a huge amount of management or maintenance time and it runs largely in the background. As I said above, all your staff have to learn is how to search.

It does however, require an open mind and a desire to finally solve the problem in the most expeditious manner possible. But, please don’t tell me you want to run a pilot. Test my solution by all means and put it through the most vigorous change control procedures but don’t damn the end result by beginning with a “we are not really sure it will work so are not really committed and won’t allocate much of a budget but let’s try a pilot anyway because that limits our exposure and risk” approach.

I don’t want to waste your time or mine.

I have written previously about the downside of outsourcing in two previous papers:

Outsourcing doesn’t save, it costs; and

Outsourcing will destroy the West.

From the above you may conclude that I am not a big fan of outsourcing and you would be correct. I have previously declared my bias and whereas my comments are largely directed at the IT industry where I work, they also apply to all industries.

Outsourcing exports jobs, exports wealth and demonstrably and significantly lowers the quality and reliability of our products, software applications and business websites. It also removes employment, training and experience opportunities for our young people.

In addition, another result of the IT outsourcing disease that began with the great fraud of Y2K is that the IT industry has been dumbed-down to such an extent that we now accept mediocrity as normal.

Let’s review that last statement; we now all accept mediocrity in IT projects as normal and, even more scarily, as totally acceptable.

For example, we all seem to accept that business websites, even of our big banks, are buggy and frustratingly difficult to navigate, especially if we want to do something even a little unusual.

Most big companies, especially airlines and travel sites and government departments tell us to do everything online but then present us with badly designed, buggy and frustratingly difficult to use websites.

How often have you had to search the website for a phone number because you weren’t able to do what you needed to do on the website or because you weren’t sure whether the transaction completed or not? How depressed and further frustrated were you when you discovered that the phone number took you to an offshore call centre?

As an IT professional responsible for major systems how frustrated are you having to ‘repair’ the buggy and carelessly tested (if tested at all) code that arrives from the outsourced developer? How many long hours do you and your staff have to spend trying to install the new code and stabilize it? How annoying is it having to support a sub-standard product that you would never put your name to? Have you given up trying to understand the objectives and motives of your senior executives who just don’t seem to care about anything but lowering costs and bigger bonuses (for them, not you)?

Another follow-on of this insidious dumbing-down process is that we now accept lower standards from our local staff. The ‘new normal’ established by outsourced work now means that we seem to accept faulty applications and faulty websites as a matter of course even when developed with local staff. What an awful trend.

We remove employment opportunities from our young people and export them to far away counties where the standards are far lower than ours. We accept the resulting poor quality workmanship as an acceptable trade-off for lowered costs and higher profits. Some executives even have the audacity to call this improved productivity.

Does any senior executive really think that the foreign nationals working on your projects really care a hoot about quality or your company or your customers or especially, your local employees? Do foreign workers really have the same pride in your products as local employees? Do foreign workers have any loyalty whatsoever to your company?

What is wrong with this picture?

Don’t we want our employees to be loyal and to take pride in their work and to care about our reputation and to care about our customers? Shouldn’t employers in turn be loyal to their employees? It doesn’t seem to be the case for many of our larger corporations.

Can we draw a long bow and generalize and say that executives that habitually outsource don’t care about product quality or staff loyalty or their company’s future or their employees or their customers? It certainly seems so to me.

Let’s talk about the economic impact. Outsourced staff spend their salaries in their home country, not here. In addition, every job outsourced means one less job here and that means less spent here to fund our economy and less taxes here to run our country. It also means less capital for local companies and entrepreneurs.

Do I think that a senior executive will read this blog and then say, “Good thinking Frank, I will review that decision I made to outsource those 30 jobs to India/Philippines/Thailand.” No I don’t; I think that the situation is now so bad that it is irreversible.

Depressingly, I think that the trend will accelerate and that in only a few years’ time we won’t make anything in this country. It won’t affect me too much because I am at the end of my career after 40 plus years in IT. But boy, do I worry about the future for my grandchildren and their children. The bureaucrats tell us we will all have to work in the services industry (does that mean working at McDonalds or at a hotel or resort or even in IT or financial services?).

My generation has already seen our manufacturing industry destroyed. We no longer make tyres or shoes or clothes and will shortly no longer make cars. It won’t be too much longer before we are totally dependent upon the outside world, especially the so-called third-world, for everything we consume. How secure a future is that?

Your generation dear reader, will most likely see most services, including IT and financial services, outsourced in the next few years.  The world is now so interconnected there is no reason to do anything in a high cost country like Australia including IT and financial services. All we will have to sell in the future is stuff we can dig up like iron ore and blind Freddy can already see how vulnerable that makes our economy.

What are we going to be left with in 10 or 20 years’ time? What are these ‘service industries’ we are all going to be working in? What will be our national Balance of Payments when everything we consume has to be imported? How independent can we be as a nation when we are massively indebted to foreign countries? What happens if they call in the loans?

How secure will this country be when we are dependent upon the third-world for everything? How vulnerable is our future security and prosperity?

Where will your grandchildren work?

Aren’t you just a little bit concerned?

I have written about this topic many times in the past (see links at the end of this post) but the lesson is always the same. There are two key rules:

1.     If your system relies on people being 100% consistent and reliable it won’t work; and

2.     If you system places an additional workload on already busy workers it won’t work.

The message is, if you simplify and automate your system you give it the best possible chance of working.

If your system works as automatically as possible and doesn’t require much effort from your workforce then it has the best possible chance of being successful.

With today’s technology and tools there is simply no need to burden your workforce with capture and classification tasks. Do you still see people still using typewriters, rotary phones or Morse code? No you don’t because there is much better technology available. So why do you persist with an old, outdated and unsuccessful model? Why do you ask your staff to manually capture and classify electronic documents and emails when there are much better, much faster, much more consistent and much more reliable ways to achieve a better result? It is after all 2014, not 1914; we all use computers and smart phones now, not typewriters, wind-up rotary phones and Morse code.

Emails are managed by email servers, (yes, even Google). Email servers allow plug-ins and add-ons and are ‘open’ so you can automatically monitor and capture incoming and outgoing emails.

Electronic documents are always saved somewhere, for example on your shared drives or directly into your DMS. As such they can be captured and interrogated programmatically.

It is entirely possible to ‘parse’ any electronic document or email and its associated attributes and Metadata and make consistent decisions about whether or not to capture it and how to classify it when captured. It isn’t rocket science any more, it is just analysis, design and programming. We can go even further and determine who should be notified and what action(s) need to be initiated in response to each new email or electronic document.  

We can easily implement an end-to-end business process whereby every electronic document and email is managed from creation to destruction and we can do this with minimal human involvement. Where human involvement is required, for example making a decision or deciding upon an appropriate response, we can also automate and manage the business processes required and simply ‘present’ staff with all the required information when required.

Isn’t this was the Knowledge Management revolution was supposed to be about?

“A system that provides the user with the explicit information required, in exactly the form required at precisely the time the user needs it.”

The new model is all about automation and processing at the server rather than at the user’s workstation; a fully automatic, server-centric paradigm. A system that is all about the ‘Push’ rather than the ‘Pull’ model. A model whereby the computer services the end user, where the end user is not a slave to the computer.

We could also call it management by exception. “Please only give me what I need to see when I need to see it.”

None of the above is new or revolutionary thinking, it is all just common sense. None of the above requires yet-to-be invented technology or products, it only requires existing and proven technology and products.

The fully-automatic, server-centric approach should be the default choice and it should be a no-brainer for any organization that needs to implement an email and document management regime. Unfortunately, too often it isn’t.

If you have the responsibility of rolling out an email and document management system and the fully-automatic, server-centric approach isn’t on your agenda then your boss should be asking you why not.

References:

White papers

Posts