Loading Data takes many hours

Sarmyles
Posts: 6
Joined: Mon May 30, 2016 7:02 pm

Loading Data takes many hours

Postby Sarmyles » Thu Mar 02, 2017 5:16 pm

I have a data set with about 200000 rows * 15 columns stored in an excel table. Simple queries load within 20 seconds.
I am using a more complicated query which refers to data in the following row using the technique described in M is for Data Monkey page 185/6. The data is text. It has now been loading for > 8hr on Windows 10 laptop with 8gb memory & 64bit excel 2016. It tells me it is loading data and Micrsoft Mashup container is using a steady 25%of CPU with 90MB of memory
How do I tell if the process is just very slow but will complete or if it has stuck/failed

Steve

MattAllington
Posts: 873
Joined: Sun May 04, 2014 4:01 pm
Location: Sydney, Australia

Re: Loading Data takes many hours

Postby MattAllington » Thu Mar 02, 2017 7:28 pm

Sounds like something is wrong to me. The technique also looks similar to this

http://exceleratorbi.com.au/use-power-q ... e-records/

I would kill the job and try some debugging, such as create a smaller file of a few hundred rows and see what happens.
Matt Allington is Professional Self Service BI Consultant, Trainer and Author of the book "Learn to Write DAX". You can hire me at http://Exceleratorbi.com.au
http://exceleratorbi.com.au/what-is-power-pivot/
http://xbi.com.au/learndax

Sarmyles
Posts: 6
Joined: Mon May 30, 2016 7:02 pm

Re: Loading Data takes many hours

Postby Sarmyles » Mon Mar 06, 2017 1:44 am

Thanks for your reply. I had tested it on a 100 row table (after several failures) which had worked OK but not for the larger table. I have watched your video and the then tried your technique. The table loaded in less than 20 seconds - 86,000 rows as expected

Thanks again

Steve


Return to “Power Query”

Who is online

Users browsing this forum: No registered users and 3 guests