Loading Data takes many hours

Sarmyles
Posts: 6
Joined: Mon May 30, 2016 7:02 pm

Loading Data takes many hours

Postby Sarmyles » Thu Mar 02, 2017 5:16 pm

I have a data set with about 200000 rows * 15 columns stored in an excel table. Simple queries load within 20 seconds.
I am using a more complicated query which refers to data in the following row using the technique described in M is for Data Monkey page 185/6. The data is text. It has now been loading for > 8hr on Windows 10 laptop with 8gb memory & 64bit excel 2016. It tells me it is loading data and Micrsoft Mashup container is using a steady 25%of CPU with 90MB of memory
How do I tell if the process is just very slow but will complete or if it has stuck/failed

Steve

MattAllington
Posts: 929
Joined: Sun May 04, 2014 4:01 pm
Location: Sydney, Australia

Re: Loading Data takes many hours

Postby MattAllington » Thu Mar 02, 2017 7:28 pm

Sounds like something is wrong to me. The technique also looks similar to this

http://exceleratorbi.com.au/use-power-q ... e-records/

I would kill the job and try some debugging, such as create a smaller file of a few hundred rows and see what happens.
Matt Allington is Self Service BI Consultant, Trainer and Author of the book "Supercharge Power BI".
https://exceleratorbi.com.au/power-bi-online-training/

Sarmyles
Posts: 6
Joined: Mon May 30, 2016 7:02 pm

Re: Loading Data takes many hours

Postby Sarmyles » Mon Mar 06, 2017 1:44 am

Thanks for your reply. I had tested it on a 100 row table (after several failures) which had worked OK but not for the larger table. I have watched your video and the then tried your technique. The table loaded in less than 20 seconds - 86,000 rows as expected

Thanks again

Steve


Return to “Power Query”

Who is online

Users browsing this forum: No registered users and 3 guests