php讀取txt檔案並將資料插入到資料庫,
今天測試一個功能,需要往資料庫中插入一些未經處理資料,PM給了一個txt檔案,如何快速的將這個txt檔案的內容拆分為所要的數組,然後再插入到資料庫中?
serial_number.txt的樣本內容:
serial_number.txt:
DM00001A11 0116,SN00002A11 0116,AB00003A11 0116,PV00004A11 0116,OC00005A11 0116,IX00006A11 0116,
建立資料表:
create table serial_number(id int primary key auto_increment not null,serial_number varchar(50) not null)ENGINE=InnoDB DEFAULT CHARSET=utf8;
php代碼如下:
$conn = mysql_connect('127.0.0.1','root','') or die("Invalid query: " . mysql_error());mysql_select_db('test', $conn) or die("Invalid query: " . mysql_error());$content = file_get_contents("serial_number.txt");$contents= explode(",",$content);//explode()函數以","為標識符進行拆分foreach ($contents as $k => $v)//遍曆迴圈{ $id = $k; $serial_number = $v; mysql_query("insert into serial_number (`id`,`serial_number`) VALUES('$id','$serial_number')");}
備忘:方法有很多種,我這裡是在拆分txt檔案為數組後,然後遍曆迴圈得到的數組,每迴圈一次,往資料庫中插入一次。
再給大家分享一個支援大檔案匯入的
<?php/** * $splitChar 欄位分隔符號 * $file 資料檔案檔案名稱 * $table 資料庫表名 * $conn 資料庫連接 * $fields 資料對應的列名 * $insertType 插入操作類型,包括INSERT,REPLACE */function loadTxtDataIntoDatabase($splitChar,$file,$table,$conn,$fields=array(),$insertType='INSERT'){ if(empty($fields)) $head = "{$insertType} INTO `{$table}` VALUES('"; else $head = "{$insertType} INTO `{$table}`(`".implode('`,`',$fields)."`) VALUES('"; //資料頭 $end = "')"; $sqldata = trim(file_get_contents($file)); if(preg_replace('/\s*/i','',$splitChar) == '') { $splitChar = '/(\w+)(\s+)/i'; $replace = "$1','"; $specialFunc = 'preg_replace'; }else { $splitChar = $splitChar; $replace = "','"; $specialFunc = 'str_replace'; } //處理資料體,二者順序不可換,否則空格或Tab分隔字元時出錯 $sqldata = preg_replace('/(\s*)(\n+)(\s*)/i','\'),(\'',$sqldata); //替換換行 $sqldata = $specialFunc($splitChar,$replace,$sqldata); //替換分隔字元 $query = $head.$sqldata.$end; //資料拼接 if(mysql_query($query,$conn)) return array(true); else { return array(false,mysql_error($conn),mysql_errno($conn)); }}//調用樣本1require 'db.php';$splitChar = '|'; //豎線$file = 'sqldata1.txt';$fields = array('id','parentid','name');$table = 'cengji';$result = loadTxtDataIntoDatabase($splitChar,$file,$table,$conn,$fields);if (array_shift($result)){ echo 'Success!
';}else { echo 'Failed!--Error:'.array_shift($result).'
';}/*sqlda ta1.txt1|0|A2|1|B3|1|C4|2|D-- cengjiCREATE TABLE `cengji` ( `id` int(11) NOT NULL AUTO_INCREMENT, `parentid` int(11) NOT NULL, `name` varchar(255) DEFAULT NULL, PRIMARY KEY (`id`), UNIQUE KEY `parentid_name_unique` (`parentid`,`name`) USING BTREE) ENGINE=InnoDB AUTO_INCREMENT=1602 DEFAULT CHARSET=utf8*///調用樣本2require 'db.php';$splitChar = ' '; //空格$file = 'sqldata2.txt';$fields = array('id','make','model','year');$table = 'cars';$result = loadTxtDataIntoDatabase($splitChar,$file,$table,$conn,$fields);if (array_shift($result)){ echo 'Success!
';}else { echo 'Failed!--Error:'.array_shift($result).'
';}/* sqldata2.txt11 Aston DB19 200912 Aston DB29 200913 Aston DB39 2009-- carsCREATE TABLE `cars` ( `id` int(11) NOT NULL AUTO_INCREMENT, `make` varchar(16) NOT NULL, `model` varchar(16) DEFAULT NULL, `year` varchar(16) DEFAULT NULL, PRIMARY KEY (`id`)) ENGINE=InnoDB AUTO_INCREMENT=14 DEFAULT CHARSET=utf8*///調用樣本3require 'db.php';$splitChar = ' '; //Tab$file = 'sqldata3.txt';$fields = array('id','make','model','year');$table = 'cars';$insertType = 'REPLACE';$result = loadTxtDataIntoDatabase($splitChar,$file,$table,$conn,$fields,$insertType);if (array_shift($result)){ echo 'Success!
';}else { echo 'Failed!--Error:'.array_shift($result).'
';}/* sqldata3.txt11 Aston DB19 200912 Aston DB29 200913 Aston DB39 2009 *///調用樣本3require 'db.php';$splitChar = ' '; //Tab$file = 'sqldata3.txt';$fields = array('id','value');$table = 'notExist'; //不存在表$result = loadTxtDataIntoDatabase($splitChar,$file,$table,$conn,$fields);if (array_shift($result)){ echo 'Success!
';}else { echo 'Failed!--Error:'.array_shift($result).'
';}//附:db.php/* //注釋這一行可全部釋放?><?phpstatic $connect = null;static $table = 'jilian';if(!isset($connect)) { $connect = mysql_connect("localhost","root",""); if(!$connect) { $connect = mysql_connect("localhost","Zjmainstay",""); } if(!$connect) { die('Can not connect to database.Fatal error handle by /test/db.php'); } mysql_select_db("test",$connect); mysql_query("SET NAMES utf8",$connect); $conn = &$connect; $db = &$connect;}?>
//*/
複製代碼
-- 資料表結構:
-- 100000_insert,1000000_insert
CREATE TABLE `100000_insert` ( `id` int(11) NOT NULL AUTO_INCREMENT, `parentid` int(11) NOT NULL, `name` varchar(255) DEFAULT NULL, PRIMARY KEY (`id`)) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8
100000 (10萬)行插入:Insert 100000_line_data use 2.5534288883209 seconds
1000000(100萬)行插入:Insert 1000000_line_data use 19.677318811417 seconds
//可能報錯:MySQL server has gone away
//解決:修改my.ini/my.cnf max_allowed_packet=20M
您可能感興趣的文章:
- php讀取txt檔案組成SQL並插入資料庫的代碼(原創自Zjmainstay)
- 基於PHP讀取TXT檔案向資料庫匯入海量資料的方法
http://www.bkjia.com/PHPjc/1102466.htmlwww.bkjia.comtruehttp://www.bkjia.com/PHPjc/1102466.htmlTechArticlephp讀取txt檔案並將資料插入到資料庫, 今天測試一個功能,需要往資料庫中插入一些未經處理資料,PM給了一個txt檔案,如何快速的將這個txt文...