C import Xls data method summary IV (upload file de duplication and database data De duplication)

C# Import .xls Data method summary IV （ Upload file and database data deduplication ）

One 、 Imported data De duplication
1.1、 Redeclare a studentVo Object list records data

// Place data in myListStudentVo China and listStudentVo Compare the data in 
List<studentVo> myListStudentVo = new List<studentVo>();

1.2、 Cycle the total number of uploaded data for de duplication

listStudentVo The data has been written in the previous article , Get the object of each piece of data circularly and connect it with the newly created myListStudentVo Object for a comparison , You can achieve a weight removal effect

// Judge whether there are duplicates in the information imported into students 
for (int i = 0; i < listStudentVo.Count; i++)
{
    
     if (i != 0)
     {
    
         for (int j = 0; j < myListStudentVo.Count; j++)
         {
    
               if (listStudentVo[i].StudentIDNum.Trim() == myListStudentVo[j].StudentIDNum.Trim() ||
                   listStudentVo[i].StudentNumber.Trim() == myListStudentVo[j].StudentNumber.Trim() ||
                   listStudentVo[i].UniformAuthenticationCode.Trim() == myListStudentVo[j].UniformAuthenticationCode.Trim())
               {
    
                   returnJson.Text = string.Format("Excel Page in the table  {0}  Duplicate data with other data ,<br> Please check the ID number. 、 Student number and unified authentication code ！", i + 1);
                   return Json(returnJson, JsonRequestBehavior.AllowGet);
               }
        }
        myListStudentVo.Add(listStudentVo[i]);
    }
     else
     {
    
         // The first data is directly put into myListStudentVo in 
         myListStudentVo.Add(listStudentVo[0]);
      }
}

Two 、 De duplication with the data in the database
2.1、 First go back to the data list in the database

// Query student table & Data from user tables 
List<PW_Student> dbListStudent = myModel.PW_Student.ToList();
List<PW_User> dbListUser = myModel.PW_User.ToList();

2.2、 Circularly processed listStudentVo Total times

The main i The idea is to make a list of the above query database, such as the list of files to be added 【 equal 】 operation , The same return true If it is repeated, it will prompt the uploader where the data is repeated

// Judge whether the imported data is duplicate with the data in the database 
// Traverse imported data 
for (int n = 0; n < listStudentVo.Count; n++)
{
    
    // Traverse database student data 
    for (int m = 0; m < dbListStudent.Count; m++)
    {
    
         if (listStudentVo[n].StudentIDNum == dbListStudent[m].StudentIDNum ||
             listStudentVo[n].StudentNumber == dbListStudent[m].StudentNumber)
         {
    
            returnJson.Text = string.Format("Excel Page in the table  {0}  Duplicate student data and database data ,<br> Please check the ID card number and student ID number. ！", n + 1);
            return Json(returnJson, JsonRequestBehavior.AllowGet);
         }
    }

     // Traverse database user data 
     for (int k = 0; k < dbListUser.Count; k++)
     {
    
         if (listStudentVo[n].UniformAuthenticationCode == dbListUser[k].UniformAuthenticationCode)
         {
    
            returnJson.Text = string.Format("Excel Page in the table  {0}  Student authentication codes already exist , Please check ！", n + 1);
            return Json(returnJson, JsonRequestBehavior.AllowGet);
         }
     }
}