Whenever you are looking to implement a new technology in your firm, you typically go through a few steps:
Figure out what is out there in the marketplace – What products are available?
Collect data about all of the technologies that may suit your use case
Rigorously compare and analyse all the data
Make a decision and go for it
There are some excellent content management tools out there for Revit now, so how can you choose? I went through a very comprehensive research analysis of a number of Revit CMS platforms, and I posted about the process here.
Then I caught up with Steve Germano over at Unifi to talk about the results. You can view (or just listen) to it here:
Feel free to comment here with your thoughts and we can keep the conversation going!
Slightly over 6 months ago, I was approached by one of my associates over at Unifi with an idea. They wanted to engage in a detailed competitive research project focused on content management systems for Revit. I was pleased that they approached me, because I obviously love Revit and I also love helping people to improve the whole ecosystem of software tools that surround Revit and BIM. In fact, I often provide too many suggestions to software companies I think 🙂
In this case, I was particularly interested in the topic as well. Having used Revit now for around 10 years, I had started to observe a trend in how Revit gets implemented into firms. Typically, they:
Buy some Revit licenses
Teach their people to use Revit
Look at ways to standardize their use of Revit, perhaps through standards and template files
Try to maximize the impact and benefit of BIM through some vertical products, such as Enscape
Start thinking about how to deal with the many gigabytes of ‘content’ they have now gathered and that is sitting on the file server in their office…
Having seen this over and over again, I knew that evaluating, choosing, and setting up a Revit content management system is no easy task, yet it is a hugely important one. It is something that often gets neglected for too long, and results in many wasted hours as people go blindly looking for ‘that family’. As you know, I willingly share time-saving knowledge, tips and workflows here and via Twitter, so this competitive research project really ticked a lot of boxes for me. I would be able to:
do a deep analysis of content management products for Revit
observe the strengths and weaknesses of each
be better informed and able to assist people who often ask me about Revit content management
provide some feedback to Unifi about how their product and offering could perhaps be improved (and as I said above, this is something I often do for free)
In this particular case, I knew that there would be a lot of time involved. I was going to have to obtain, install, test, benchmark, and document a whole lot of information about various Revit content management systems. As a father of three, a technology blogger, and someone who works almost daily for different companies delivering various projects, time is extremely hard to come by. So I felt it was quite appropriate in this instance to be commissioned by Unifi to perform this research task. I had never been part of a commissioned, competitive research project before, so I knew there may be some challenges. However, given the amount of time that would be involved, I would only be able to do a proper and thorough job if I was reimbursed for the time I would need to dedicate to it.
You might say that being commissioned for the task introduced some bias, but I’ll tell you why that cannot be true. Unifi wanted to know how to improve their product, they basically wanted to know what could be improved so that they could remain competitive with their competitors. For me to somehow do a biased job would have been way off-base. I needed to be honest, and brutally so. I had to show the Unifi people if and how their competitors were stronger than they were. I admire the fact that Unifi undertook this whole project. Evidently, they wanted to make sure their product was the best it could be. Personally, I would have an avid listener, someone who would be happy to hear all of those software ideas that I come up with!
So I accepted this project as a commissioned, competitive research task. I would record my results and provide a number of comprehensive deliverables back to Unifi. How would I go about this job? There were a few logical steps:
establish the list of products that would be researched
obtain the products
install them onto a test workstation
evaluate the features available in the product and fill out a detailed comparison matrix
perform benchmarks to establish speed, performance, and capability of each product
use some large sample content datasets to really put the products through an intensive test to check for problems that may occur with huge content libraries
Looking at the above steps, you can see how much time would be involved. But I also thought it would be a good idea to involve the developers of the competing products in the research. I thought that if I could be better informed about the other products, my research output would be more complete and accurate. And I still think that this was the right approach. I spoke to some of the competing companies and described the fact that that I was doing a detailed research project and would like to discuss their product with them. Most of them knew me as a blogger and technology professional, and so they were pleased to meet and discuss their content management product.
And then I made a mistake.
I should have started those meetings by saying that I had been commissioned by Unifi to do the research project. But I did not mention that fact. We had informative meetings each time, that helped me to get a better understanding of each product. But I can see now that I should have simply told them how the research project came about. I actually don’t think it would really have influenced the discussion a whole lot, because I still think it was in their interest to assist me in understanding their product. However, I do feel like I should have been transparent at the time. I would like to publicly apologize to those competing companies for not initially disclosing that I was commissioned to do the research.
This was a lesson learned for me, and one I won’t make again if I undertake a similar research project in the future.
I do not apologize for taking on the research project, because it was simply the best way that a task like this could be handled, and I do believe I was the right guy for the job. I understand that it is quite common for companies to engage 3rd party professionals to perform market research, but for me it was my first time. As stated above, my thought process was basically that:
I would receive some reimbursement for my research time, that
I knew the research output had to be complete and accurate and honest, and that
It would be beneficial to speak to the individual developers about their product.
Following the consultation phase and data gathering phase of the project, I had quite a substantial amount of data to work with! How would I filter through all of this and truly make it comparative?
To begin with I put a lot of information and notes into a detailed OneNote notebook. I then started an Excel document where I would store most of the comparative results. I had a few key worksheets where most of the raw data was stored:
The Matrix worksheet contained a whole lot of data, over 150 rows and 15 columns. I broke the testing and comparison up into some major categories:
Note: the UX2 value above refers to things like bugs or user interface problems, and in that case a higher score would be worse (more bugs).
For feature comparison, I used a weighting value and a formula. Here is a sample of some of those weighting values:
So, in the case above, I viewed Parameter Searching as more important (5) than Uniformat Filtering (2). These weighting values are based on my experience and my association with other BIM professionals.
From this point, I reviewed the capability of each product and used a Yes / No value to determine if a given product would ‘score’ for that feature:
If a product achieved a Yes value here, it would also obtain the Score for that Feature.
I used a set of PivotTables and Charts to break down and review that feature data.
I also performed some performance and speed benchmarks, and stored these in another worksheet:
Ultimately, this data was all collected and provided in combined form along with some Powerpoint slides. The slides cover topics like:
What is BIM Content?
What is Revit Content?
Why Content Management?
How is Content Managed?
How do I choose?
Along the way, we had to do a few interesting things. We were finding that the Australia internet speed was not really a good place to start with cloud benchmarking. So we obtained a cloud based virtual workstation that more closely reflected the type of internet speed you would experience in the USA, and I then had two sets of ‘cloud speed’ benchmark data, the Australian and the US versions.
An example of how some of my research was used may be seen in the recent new offering by Unifi. The research identified some differences in the pricing models of the various products, and this information assisted Unifi in the creation of an additional pricing model.
Where can you learn more about this research? A couple of weeks back I mentioned that the details and results of the competitive research project will be shared in a global webinar.
In summary, I really enjoyed doing this research project and I think the results will be useful to Revit users and BIM Managers who are trying to evaluate different content management tools. It is true that they each do have certain strengths, so which will you choose?
PS. It is interesting to look back, to where almost a year ago I asked you all:
Which content manager for Revit would you recommend?
Recently I undertook a very detailed and intensive research project focused on BIM and Revit Content Management Systems. The results of that research will eventually become fully available… In fact it will be discussed in detail at an upcoming webinar (register here).
The research covered a range of product categories including Revit Integration and Management features. However, it also considered the cost and ROI of various content management systems. On a related note, I was very happy to hear that Unifi have now released UNIFI Standard, a content management solution for firms with less than 30 design staff, offered at the very attractive $14/month. Basically, as a smaller firm you can still afford to access a lot of the awesome Unifi Content Management features, but there are service level differences that mean it makes more sense for larger firms to stick with UNIFI Enterprise.
licensing model is named user – each person is assigned a license
price is $14/user/month
there are service level differences between Standard and Enterprise (level of support, customer/account management, onboarding services, SSO integration) although both products have access to the same content management features.
UNIFI Enterprise remains for firms who need more than 30 licenses and it will have two licensing models – active users or open/concurrent licenses. The pricing will be dependent on what type of license and how many are needed.
Good Revit Content management does not come immediately or without forethought. Unifi are giving you another chance to review some best-practice content management principles at an upcoming webinar. It should be very interesting to hear about some of the productivity and functionality improvements that are becoming available to allow you to manage your BIM content more effectively.