Load data to Oracle db through flat file

Is there a way to load data from a flat file to an oracle table. I am using following python code but the file is too big and the script stops after sometime (due to lost db connection).

from tqdm import tqdm

insert_sty = "insert into MRSTY (CUI,TUI,STN,STY,ATUI,CVF) values (:0,:1,:2,:3,:4,:5)"
records=[]

file_path = "../umls_files/umls-2023AA-metathesaurus-full/2023AA/META/MRSTY.RRF"
num_lines = sum(1 for line in open(file_path))

with open(file_path, 'r') as f:
    for line in tqdm(f, total=num_lines, desc="Processing file"):
        line = line.strip()
        records.append(line.split("|"))

    for sublist in records:  
        if sublist:
            sublist.pop()
    
for i in tqdm(records, desc="Inserting records"):
    try:
        cur.execute(insert_sty,i)
        print ("record inserted")       
    except Exception as e:
        print (i)
        print("Error: ",str(e))
        
conn.commit()

As you use Oracle, I'd suggest <a href="https://docs.oracle.com/en/database/oracle/oracle-database/19/sutil/oracle-sql-loader.html">SQL*Loader</a>. It is utility which loads data really, really fast.

In a few words, how it works:

• you have a file to be loaded
• if you have Oracle database installed on your PC (or installed Oracle Client), you have SQL*Loader utility
• create a control file (by following instructions described in link I posted)
  • it instructs the utility where to find source data, which database table is the target, are there any other options you want to include, etc.
• run it
  • it is done by calling the sqlldr executable at the operating system command prompt
  • this is where Python might be involved - just to call the utility
• wait until it is over; check the log file for more info

Have a look at short overview <a href="https://www.oracletutorial.com/oracle-administration/oracle-sqlloader/">here</a>.

P.S. Forgot to mention: if you posted table description and provided several rows of sample data, we could've helped with composing the control file and demonstrate how it would've worked.