EF core reading text type is slow_ EF core is slow to read large string fields

One 、ef core Read text Type slow _ef core Reading large string fields is slow

analysis ：

When the server configuration is low ,text The rich text string is larger than 100kb When , Use ef Reading data is significantly slower .

Two major features of slowing down ：

1.text Type rich text field content is too long ,100kb above

2. When reading, it is also associated with the data of other tables .

These two characteristics , Lead to ef core Slow reading of data , Slow obviously .

Solution ：

Business plan ：

Suggest text Do not store too large characters in the field ; When the client edits rich text , Remove the style after copying and pasting , Rearrange .

Business plan is preferred , If the field needs to be large , Consider the following technical proposal .

Technical solution ：

1. List read content To filter out text Field of , Do not read large text from data

2. Read details , Associate table data with text The fields of are queried separately or , Split into 2 Interface .

Two 、ef core Large text field list reading optimization

Before optimization ：

    var list = query.Include(q => q.Sch_Label).Include(q => q.Sch_Month).Skip(skip)
                .Take(10)
                .ToList()
                .Select(q => new
                {
                    q.ID,
                    q.Name,
                    q.Logo,
                    q.ViewCount,
                    q.CreateTime,
                    AreaShow = q.GetAreaShow(),
                    MonthShow = q.GetMonthShow(),
                    LabelList = q.Sch_Label
                }).ToList();

After the optimization ：

  var list = query
                .Include(q => q.Sch_Label)
                .Include(q => q.Sch_Month).Skip(skip)
                .Select(q => new School() {
                    ID = q.ID,
                    Name = q.Name,
                    ViewCount = q.ViewCount,
                    CreateTime = q.CreateTime,
                    Logo = q.Logo,
                    Sch_Month = q.Sch_Month,
                    Sch_Label = q.Sch_Label
                })
                .Take(10)
                .ToList()
                .Select(q => new
                {
                    q.ID,
                    q.Name,
                    q.Logo,
                    q.ViewCount,
                    q.CreateTime,
                    AreaShow = q.GetAreaShow(),
                    MonthShow = q.GetMonthShow(),
                    LabelList = q.Sch_Label
                }).ToList();

The performance improvement is quite obvious .

3、 ... and 、ef core Large text field detail reading optimization

Association table and text Big text fields , Separate access ; Significantly improved performance .

Before optimization ：

        // For more details 
        public IActionResult GetDetail(int id)
        {
            var model = _school.GetQueryable().Where(q => q.ID == id)
                .Include(q => q.Sch_Image)
                .Include(q => q.Sch_Label)
                .Include(q => q.Sch_Month)
                .FirstOrDefault();

            JObject obj = JObject.FromObject(model, MvcContext.GetJsonSerializer());
            // School Video 
            VideoOperate _video = new VideoOperate();
            var videoList = _video.GetBySchool(id, 8).Select(q => new
            {
                q.ID,
                q.Title,
                q.ImgUrl,
                q.ViewCount
            });
            obj.Add("videoList", JArray.FromObject(videoList, MvcContext.GetJsonSerializer()));

            // Traffic ++
            model.ViewCount++;
            _school.Modify(model);
            return Json(obj);
        }

After the optimization ：

        // For more details 
        public IActionResult GetDetail(int id)
        {
            var model = _school.GetQueryable().Where(q => q.ID == id)
                //.Include(q => q.Sch_Image)
                //.Include(q => q.Sch_Label)
                //.Include(q => q.Sch_Month)
                .FirstOrDefault();

            //JObject obj = JObject.FromObject(model.Result, MvcContext.GetJsonSerializer());
            // School Video 
            //VideoOperate _video = new VideoOperate();
            //var videoList = _video.GetBySchool(id, 8).Select(q => new
            //{
            //    q.ID,
            //    q.Title,
            //    q.ImgUrl,
            //    q.ViewCount
            //});
            //obj.Add("videoList", JArray.FromObject(videoList, MvcContext.GetJsonSerializer()));

            // Traffic ++
            model.ViewCount++;
            _school.Modify(model);
            //return Json(obj);
            return Json(model);
        }
        // Get related table data 
        public IActionResult GetDetailMore(int id)
        {
            VideoOperate _video = new VideoOperate();
            Sch_ImageOperate _img = new Sch_ImageOperate();
            // School pictures 
            var Sch_Image = _img.GetQueryable().Where(q => q.SchID == id).OrderByDescending(q => q.Sort).ToList();
            // School labels 
            var Sch_Label = _img.Context.Sch_Label.Where(q => q.SchID == id).ToList();
            // School month 
            var Sch_Month = _img.Context.Sch_Month.Where(q => q.SchID == id).ToList();
            // School Video 
            var videoList = _video.GetBySchool(id, 8).Select(q => new
            {
                q.ID,
                q.Title,
                q.ImgUrl,
                q.ViewCount
            });
            return Json(new
            {
                Sch_Image,
                Sch_Label,
                Sch_Month,
                videoList
            });
        }

Other related ： What a big pit ： EF Core Reading large string fields asynchronously is slower than synchronizing 100 Many times | Easy to learn

more ：

EF Core Write data in batch and use it for sorting （ Two ）Z.EntityFramework.Extensions.EFCore

EF Core Write data in batch and use it for sorting _EF Core Bulk insert data （ One ）

EFCore Association table query _ Use multiple tables to organize