Entity Framework poor performance on SaveChanges in large batch job [duplicate]

Question

We have a requirement to read a load of xml files, run validation on them, transform them into entities and stores them in the database. This was being done using a repository wrapping Entity Framework.

What we have found is that Entity Framework slows the process down to the point where it doesn't process the records quickly enough. We profiled the application and the worst performing method was the SaveChanges on the EF context.

We are thinking of introducing threading as a possible solution.

Has anyone any other ideas of how we can speed up the process?

this might can help you, stackoverflow.com/questions/21272763/…, or this 1, stackoverflow.com/questions/5940225/… — Se0ng11
– Se0ng11, Commented Aug 27, 2014 at 9:30
Gert, thanks for the help, we have a loop looping through a lot of xml files, reading them into objects, doing validation on the objects and saving changes. — Burt
– Burt, Commented Aug 27, 2014 at 9:44

devGirl · Accepted Answer · 2016-04-02 19:35:34Z

0

I had this problem for csv files one time. The problem was that I tried to save all my records with only one SaveChanges() because transaction was required.

I divided it (1 for 1000 records) and it resolves my performance problem. Also, you can try to disable auto detect changes during your threatment.

I hope it helps :)

answered Apr 2, 2016 at 19:35

devGirl

584 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Entity Framework poor performance on SaveChanges in large batch job [duplicate]

1 Answer 1

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Linked

Related