Quiz – which version of Revit was the last one to include ‘in product’ indexing of point clouds?

Answer – Revit 2018 included AdPointCloudIndexer.exe, which could be used to index an array of raw point cloud formats into Recap

Raw formats that could be processed by AdPointCloudIndexer.exe

If a raw format was selected (up to Revit 2018) would prompt to index the file:

You could choose some settings and Start Indexing:

Then you would have to restart the process and Insert -> Point Cloud and choose the newly indexed RCS.

Image below shows existence of AdPointCloudIndexer.exe in the Program FilesAutodeskRevit location:

The modern-day solution is of course to use Recap.

This post from The Building Coder also offers some insight into the history.

This is basically what will happen:

So, basically you can choose to re-index to RCP, or leave them as-is and continue to use the PCG.

While there is much to love about the smooth performance RCP point clouds, I have to admit that PCG point clouds seemed to allow:

  • greater point density, perhaps due to different default indexing settings, 
  • more consistent display (ie. once the view had regenerated, that’s how it would stay – while RCP seems to slowly and continuously re-gen until you get a very realistic view)
  • and didn’t have cropping problems – I’ve noticed that a 3D Section Box with an RCP point cloud will require a greater “buffer” than with PCG.  If you crop it too close, the RCP points won’t show (even if they physically exist in that section box space).
On the flip-side, PCG point clouds are typically much larger than the RCP / RCS equivalent.

Related forum post:
Point cloud disappears partially revit 2014 – Autodesk Discussion Groups

The scenario: you receive raw point cloud data, and want to process it in Recap (part of 2014 suite), export to PCG, and import back into Revit 2013.

Or: you request a PCG from a surveyor for Revit 2013, and they give you a “newer” PCG from Recap that will not import.

The error received in Revit 2013 is:
“Unable to create a Point Cloud instance.  The file may be an incompatible format or corrupt.”

However, if you index the same raw point cloud data using Revit 2013 built-in indexing, the resulting PCG will work fine.

It would seem that there is some difference between the built-in Revit 2013 indexing of PCG point clouds, and the PCG point cloud exporter in Recap.

Workaround:

  1. Process the raw data in Recap (requires indexing time)
  2. Export to PTS file
  3. Import the PTS into Revit 2013 (requires indexing time — again)

Navisworks may have issues importing PCG point cloud files.  For example, if you try to append a PCG directly to Navisworks Manage 2013, it will say “No plugin exists that will open pointfile.pcg”.

If you try to export a view from Revit 2013 to Navisworks and it contains a linked point cloud file, the point file will not be converted even if the “Convert linked files” option is ticked in Navisworks settings.

Here are some workarounds:

Some have recommended importing the PCG into AutoCAD, and export an NWC from there:
Revit OpEd: Point Cloud Data into Navisworks
Point cloud import – Autodesk Discussion Groups

You can also:

  • Import PCG to AutoCAD, then append the DWG to Navisworks
  • get PTS from Cyclone, or even TXT, and then append it directly to Navisworks
As per:

Point Cloud files imported into Navisworks & Revit from Cyclone, .pts vs .ptx. | LinkedIn

Depending on the size of the original point cloud file, it will take some time for Navis to make the necessary indexed NWC file (like half a day maybe).

Obviously, if you are living in 2014-Suite-Land, you can also just use Recap to import the PCG and export as a supported file format for Navisworks.

A 2008 PDF that describes the point cloud types Navis supported:
http://www.sparpointgroup.com/uploadedFiles/News/PDF/peterquinn.pdf

Update:
I am enjoying using inverted background (black) when working with Revit and point clouds.

Also, you MUST use this add-in by Harry:
What Revit Wants: 3D Section Box crop add-in WITH automatic rotation – Boost Your BIM

I find it interesting that we can receive a point cloud (laser scan) of a project, which essentially describes the geometry and colour of the whole 3D space, and yet have to re-model everything in Revit elements to make it actually useful in a BIM / FM context.

It reminds me of the early days of document OCR – you could scan a document, but there was no easy way to infer the intelligence (text) of the document.  Happily, OCR software improved, and I hope that geometry-from-point-cloud automation will also improve.  Bring on the automatic, one-click “Make a Building from my Point Cloud” solution.  In the meantime…

This post is about my experience working with point clouds and Revit 2013 on a recent project.  I explored various different workflows and add-ins.  I will add to this post over time to make it as useful as possible.

On the project in question, we received the following from the surveyor:

  • Leica TruView data set
  • RCS point cloud
  • PTX point cloud
A note on file formats: PTX files keep scanner information (including roto-translation in the head, each point keeps all information XYZIRGB, allowing surface normals to be calculated).  Interestingly “Many scan packages including Polyworks, Rapidform, and MeshLab read the PTX format and offer meshing operations that will allow you to create a polygonal mesh from a PTX”. PTS files are simply the point locations and RGB values, each point forming a new row of data in the file. (more here)

We did not receive:

  • 3D geometry or Revit elements of any kind
We knew that:
There are a number of different workflows available:

  • native Revit tools (in my case, using Revit 2013)
  • Scan to BIM add-in by Imaginit / Rand (around $3000 for Standalone license)
  • Leica Cloudworx for Revit (around $4000)
  • Visualizing in Navisworks and modelling in Revit
  • Revit 2012 and the Point Cloud Feature Extraction labs add-in (if you can find it anywhere)
  • using Point Clouds in the Revit Family environment
Note 1:  I initially had problems using a combination of Revit 2013, Scan to BIM and Leica Cloudworx.  For example, Wall Region Grow would report “No points found in this area?”  However, if you zoom in and click exactly on a visible point from the Cloudworx point cloud, Scan to BIM should be able to pick it up.  A representative of Imaginit / Rand reports that Clients often do use both tools together.

Note 2:  Note 1 is apparently a known issue.  Workaround with 2014 and Recap is to bring the raw format scan into Recap, export it out as a .pcg file. Create a new project inside of recap and bring in that pcg file and save that off as a rcp… that error msg should no longer appear. (Thanks Cheyne Bird, IMAGINiT Australia)

Initial thoughts:
Scan to BIM seems to be the better tool for feature extraction and geometry creation, while Leica Cloudworx puts you in direct contact with the original point cloud data – not decimated by Revit.

General Tips:

  • Revit will consume big amounts of memory when working with large point clouds
  • Rule of thumb – indexing a 27 gb PTX
    will result in a 7gb PCG and
    will take about 7 hours for a mid-range PC.
  • Indexing 2 x 27 gb PTX using Recap version 1.0 and basically default settings
    about 6 hours
    8gb for new PCG
  • Working with 2 of these 7gb PCG files in Revit 2013 on XP64 with Scan to BIM will consume about 11gb of RAM easily.  You may have to periodically close and re-open Revit, depending on your system specs.
  • Working on the same point files using Cloudworx will consume about 2gb of RAM, depending on your view settings.
  • If you are using Revit 2013 and you want to restrict Revit from highlighting (pre selecting) a point cloud, which can be annoying, just place it in a Design Option.  It seems that Scan to BIM can still interact with a Point Cloud in a primary option of an option set.
  • Did you know that Point Clouds when imported to Revit have a Phase Created and a Phase Demolished parameter?  Revit respects this when it comes to Phase Filters and Graphic Overrides – keep this in mind if you can’t ‘find’ a point cloud in your project.
  • You will be working in 3D a lot, and making lots of 3D views cropped to section boxes.  I recommend that you set keyboard shortcuts for:
    Orient to a Plane, and
    Set Current View as HomeUsing these shortcuts, you can quickly reorient yourself and use the Viewcube properly.
  • The above workplane shortcuts work well after using the “Set Workplane” tools in the various add-ins.  After triggering Orient to a Plan, just click OK.  When Revit says -not associated-, it means ‘use the current workplane’.  You should also set and use a keyboard shortcut for the Show Workplane button on the Home tab.
  • When making a new 3D view, the quickest way is to select an existing Section Box and copy it using Revit copy (not Ctrl C) and drop it close to new desired location.  It will appear in Project Browser with same name as previous 3D view, but with any digit on the end of the view advanced by 1.  This is actually better than using Duplicate View, which adds this silly “Copy of” to the front of the new view name.
    Note: This new Section Box will also remain selected, so you can adjust the crop before switching to the newly created view
  • You may wish to turn off “Snap to Remote Objects” in your Revit snaps, these can get in the way when working with Scan to BIM, and Point Clouds generally
  • To facilitate setting of a Workplane based on already modelled geometry, I made a simple 3 point adaptive component with a surface formed by these 3 points.  You can use Set Workplane to pick this triangulated plane and work from there.

Scan to BIM:

I recommend you watch this video to start:


You can also access an archive of webcasts by filling out this form.

Workflow (walls):

  1. Crop 3D view with Section Box as much as possible
  2. Use Wall Region Grow tool (3 point click on face)
  3. Adjust wall edge extents
  4. Rinse and repeat
Carving – A quick way to reduce the extent of the wall is to use the Split Tool – rather than trying to find the edge, just Split the wall horizontally or vertically or both, and delete the bit you don’t need.

Sloping / Slanted Walls – You can either use the Wall by Face option on the Wall Region Grow tool, or create an inplace wall out of extrusions by using the Set Workplane tool.  The latter is preferred if you want to modify the resulting wall in any way.

Optionally – use the “Work on Wall” button, Select Wall, and use the resulting section to edit wall profile, add windows etc.

Workflow (topography):
The topo creation tools in Scan to BIM work great.  You essentially get to pick points, choose decimation, and then you get a topo.  Easy, right?  Well, then you have to clean it up.

Workflow (columns):
I suggest you get rid of all column types in the project, and just keep one Round and one Rectangular OOTB column family loaded.  If you use Structural Columns, you can schedule them…

  1. Crop 3D view with Section Box as much as possible
  2. Pick appropriate column tool (Round or Rect)
  3. Make a crossing window over column points
  4. Pick correct column type family or load a new one
  5. Click Create Column

Note – you may have a bit more joy if you switch the 3D view to “Top” before selection the column crossing window

For angled columns, you can use the Slanted – End Point Driven option in the Properties Palette.  In fact, if you want to tweak column height while in a 3D view, switch to Slanted – End Point Driven, adjust using the end points, and then switch back to vertical…

Workflow (floors):

  1. Crop 3D view with Section Box as much as possible
  2. Determine an approximate height for the floor
  3. Sketch the floor outline, using the height from 2
  4. Select the Slab, and then start the Scan to BIM Adjust Slab tool
  5. Select points

Tip – in a 3D view when using the Adjust Slab tool, you may have a better experience if you switch to Wireframe first.  This stops model elements from occluding the Analysis Result that shows you the slab deviation.

Personally, I find the use of Floors to be a bit more frustrating than that of Topos.  It would be nice to have a Floor tool that works essentially the same as the Topo one – select a bunch of points, decimate them heavily, and use them as the top surface of a Floor element.

Workflow (Curtain Walls and Glazing):
This is a simple two point click.  Use “Work on Wall” to make a perpendicular wall section of the hosting wall.  Then click one corner and then the other of the glazed area.  Adjust mullions according to point cloud.

How to get it:
To get Scan to BIM, use these links:

Scan To BIM (Standalone)

Scan To BIM (Network)

Cloudworx / Cyclone:
Installation notes:

  • To use Cloudworx add-in for Revit, you must have Cyclone installed
  • I had a GUID conflict for the Revit add-in when installing Cloudworx, I posted the resolution here
  • I also had a license error.  I had to open Cyclone itself and switch it to VIEWER mode.  I ended up receiving a trial license.dat, and put this in the appropriate folder.

We received a folder containing the Cyclone databases.  The key file is an IMP file.  In Cyclone:

  1. Configure – Databases
  2. Add…
  3. Select the IMP file
  4. The surveyors database will now be accessible to you

To use this data in Revit:
Add-ins, Import ModelSpace View.  Then drill down in the Cyclone database until you find the appropriate view.  I found one based on a known coordinate system and it was a ‘unified’ view.

You can import multiple point cloud sources.

Cloudworx plugin strips out existing point clouds from the project and replaces it with a database link, that looks like this:

I immediately noticed that navigation (using Revit 2013) was much faster with Cloudworx than with the native PCG files.

As you zoom in and out, Cloudworx will ‘throw away’ or add points to keep the view relevant to your context (as well as maintaining graphic performance).  Use the Rendering options on the Cloudworx ribbon to set your desired view (such as True Colour).

When you save the Revit project containing the Cloudworx DB link, you will be prompted to save a .cwprj file.  Make sure you do this.  After closing and re-opening Revit, the Cloudworx data will be gone.  You use the Open option from the Cloudworx add-in to recover your previous work (view links, view settings etc).

Workflow:
Once you have imported the Cloudworx database, the essential workflow seems to be:

  1. Clip a view to the elements you want to model
  2. Use the Workplane command from the add-in (this make a new workplane from surrounding points and sets it current)
  3. Make a new in-place family, with geometry (typically extrusions) based on this workplane
  4. Rinse and repeat

What’s it for:
Cloudworx doesn’t have anywhere near the sophisticated geometry creation tools included in Scan to BIM.  However, it does provide a facility for clipping point clouds, visualizing them, saving view states and setting workplanes.  In terms of exploring the Point Cloud, it is actually the superior tool.  You just can’t make anything “Revit” from it.

Leica Cloudworx Training
HDS – Training

Category: Civil/Survey
Module Name: CloudWorx for Revit
Instructor/Presenter: Introductions by Andrea Fournier, Instruction by Michael Harvey and David Langley
Description: This class is an in-depth look at the CloudWorx for Revit software. Follow along with the instructors with the supplied database to practice each of the concepts. Items that the class covers are slicing, clipping, limit box, drafting walls, drafting floors, drafting pipes, and many more.

You need to register before accessing the training…

Heads-up for this training:
revit | POINT CLOUD GURU

Using Points In Families
In videos below, the following workflow is described:

  1. Clip points in Recap
  2. Save as PTS file.   Optionally, compress to LAS using this workflow.
  3. Use a LISP tool like PointsIn or PTSIN to import Point Cloud to a AutoCAD DWG file.  Optionally, place a block element at each point to allow easy snapping in Revit.
  4. Import the DWG to a Revit Family of your choice
  5. Do your modelling, and save and load your Family into the Project.  Recommended – delete the source DWG and purge the Family to decrease overhead.

PointsIn is available at:
Survey Points Import and Create Free AutoLISP (LISP) for AutoCAD

Direct:
http://www.hawsedc.com/gnu/pointsin-v1.0.8.zip

Also, the PTSIN lisp is available at:
FreeCADapps Freeware, Shareware and Evaluation Software

Videos:
Playlist of LTC3D videos embedded below.  Of particular interest:

  • video showing Edgewise workflow (automated pipe creation)
  • video showing the clipping of points in Recap, then import to AutoCAD using PTSIN, then Import to family environment.  This allows creation of component families using point data (alternative method would be to make an in-place family in the project environment and then save to RFA).

Cadalyst and Leica Geosystems Webcast: Point Clouds for Revit Modeling | Cadalyst

Example Scan to BIM project:

Using Navis to visualize point clouds?

Note on using Navis:

Overview of Recap Studio:
Can export PCG from RCS to downgrade 2014 points to Revit 2013…
via BIM blog.ca: Don’t recreate… ReCap

Discussion – getting a license for Cloudworx, and a comparison between Cloudworx and native point cloud
Laser Scanning Forum Ltd • View topic – Leica CloudWorx for Revit

Using Cloudworx Plugin:
9.The next stage is to bring in the point cloud from a Model Space. From the Add-Ins tabs choose Import MS View, fill in the correct settings for the Connection String and Coordinate Systems. Note that Cloudworx is automatically defaulting to the internal units of Revit (Feet) but that it is correctly applying a scale factor.via Point Clouds in Revit – BIM Toolbox

Creating Geometry (snapping):
Controlling visibility: Control the visibility of the point cloud on the Imported Categories tab of the Visibility/Graphics Overrides dialog, as well as on a per-element basis. You can switch the visibility of the point cloud on or off, but you cannot change graphical settings, such as Lines, Patterns, or Halftone.

Creating geometry: A snapping feature simplifies model creation based on point cloud data. Geometry creation or modification tools in Revit (such as wall, line, grid, rotate, move, etc.) can snap to implicit planar surfaces that are dynamically detected in the point cloud. Revit only detects planes that are perpendicular to the current work plane (in plan, section, or 3D) and only in a small vicinity of the cursor. However, after the work plane is detected, it is used as a global reference until the view is zoomed in or out.
via the Revit 2013 wiki at
Using Point Cloud Files in a Project – WikiHelp

Scan to BIM workflows PDF:
This is a pre Revit 2012 workflow and uses AutoCAD as middle man quite heavily… it also recommends Scan to BIM:
GORUG Presentation April 5th – Andre Carvalho

AU2011:
Laser Scanning to BIM: If You Look at It Long Enough You Might Model Something

Converting a PTS to LAS for easy import into Revit or Civil3D:
The LAS format is lighter than PTS, convert using free point.zip
via
Civil 3D GURU CONVERGENCE: PTS to LAS POINTCLOUDS in CIVIL 3D

Leica Download links:
Cloudworx Plugin PDF:
 http://hds.leica-geosystems.com/downloads123/hds/hds/cloudworx/brochures-datasheet/Leica_CloudWorx_for_Revit_DAT_en.pdf
Actual Plugin:
http://hds.leica-geosystems.com/downloads123/hds/hds/cloudworx/pc_software/CloudWorxForRevit103.exe

All downloads:
Cyclone Downloads – Leica Geosystems – HDS

Cyclone 8.0 Downloads – Leica Geosystems – HDS
Direct: http://hds.leica-geosystems.com/downloads123/hds/hds/cyclone/pc_software/CycloneSetup803-x64.exe

Leica TruView direct download: http://hds.leica-geosystems.com/hds/en/TruViewSetup30.zip

More tips:
the portion of the point cloud visible between the bottom extent and the cut plane is visible.Visibility of Point Clouds – WikiHelp

Once indexed, be sure to link in each PCG file using the “Auto – Origin to Last Placed” option in the “Link Point Cloud” dialogBest Practices – Working with Multiple Point Clouds in Revit – WikiHelp

Other stuff:

It goes without saying that you can’t interrupt a point indexing process in Revit – you will probably end up with a corrupt point file, as per:

PS.  Why do I have this feeling that this might be my most visited post this year?

Update:
You may also be interested in Edgewise for Plant
http://www.clearedge3d.com/products/edgewise-plant/#ewpvideo

Key website for E57 data and resources:
http://libe57.org/

Some basic info from the website:

Is the E57 format XML?

The E57 specification uses a subset of XML that has been extended to support efficient storage of large amounts of binary data. An E57 file is encoded as a hierarchical tree structure, some of which is encoded in XML, and some of which is encoded in a binary format that is not XML. The bulk of the data, including point data and images, is encoded in the binary sections for efficiency. Metadata, such as sensor pose information, is encoded in XML. The binary sections are not embedded in the XML section. Instead, they are located in separate sections of the file and referenced from the XML section.

Is the E57 format extensible?

Yes. One of the greatest strengths of E57 is that it was designed to be readily extensible to accommodate new hardware innovations.

How does this all fit in with Revit?
… Revit 2014 does support the import of E57 through the new Recap software released a few weeks ago. The primary idea is that by using E57 you will have support for nearly all of the laser scanner vendors’ data since they can write an E57 file and Recap can read it. That will allow you to import it and then convert it to a Revit format to use the data. It’s a data exchange format, not a working format.
 
We are now trying to recruit some new people the ASTM E57 committee who can help us define and move forward on a number of extensions to the basic format.
(above paragraphs via email)

Could we laser scan the world, make a big point cloud, and then import it into Revit?  Well, one day we might be able to accomplish that on a small scale (then again, maybe not).  In the meantime, try this process:

  1. Make the point cloud from existing geometry using this guide
  2. Use GreenSpider (more info at this link) to bring the points into Revit (and ‘maybe’ make a form using splines)

I’m sure results will vary… please comment if you try it out.

    Point clouds are getting a lot of “press” lately, and they can be very useful.  But let’s say, hypothetically, that you have a 3D model of a building or a component and you want to deconstruct it back into a point cloud –  Can this be done?  Yes, and quite easily…

    1. Open the 3D model in 3dsMax
    2. Export to STL
    3. Import the STL into MeshLab (File – Import Mesh)
    4. Export the mesh as an XYZ file (File – Export Mesh As…)
    5. This XYZ file can now be imported into Recap, or indexed by Revit into a PCG, or used in various other software tools

    Note:  You can also create STL files (steps 1 and 2) directly from Revit using the STL Exporter add-in.

    Some of these tools were discussed at:
    Free 3D PDF from Revit STL using Meshlab, MiKTeX and U3D-2-PDF

    Very cool tip from Ben Malone – he shows you how to use AdPointCloudIndexer.exe from a command line (outside of Revit) to prepare point clouds for practical use.  A typical 2013 location for this utility is:
    C:Program FilesAutodeskRevit Architecture 2013ProgramAdPointCloudIndexer.exe

    2g9o56133xxc8gok-6223585
    Image from BIMopedia

    Read the whole post at:
    Stand alone indexing of RAW point cloud data into .pcg files | BIMopedia

    If you want to know more about different point cloud formats / file extensions, there is some info on the wiki:

    • Point Cloud Projects (*.rcp): Pick an indexed point cloud project file with .rcp extension. An .rcp is an aggregation of multiple .rcs point cloud files.
    • Point Clouds (*.rcs): Pick an indexed point cloud file with .rcs extension.
    • Raw formats: Pick a file with an extension in the list to automatically launch an indexer application that will convert the raw file to an indexed file.
      Note
      After the indexed file is created, you must use the Point Cloud tool again to insert the file.
    • All Files: Pick a file with any extension.

    via
     Inserting a Point Cloud File – WikiHelp