bishwajeet.rajak/neft_outward_file_based
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

updated config

Browse Source
This commit is contained in:
Bishwajeet
2026-03-18 15:29:09 +05:30
parent b9dc68254c
commit 611e56d0b3
5 changed files with 139 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

BIN
db/__pycache__/repository.cpython-39.pyc
View File

Binary file not shown.

4
db/repository.py
View File

@@ -280,9 +280,9 @@ class Repository:
try:
cursor.execute("SELECT COUNT(*) FROM outward_neft_api_log WHERE ROWNUM = 1")
logger.info("✓ inoutward_neft_api_log table exists")
logger.info("✓ outward_neft_api_log table exists")
except Exception as e:
logger.error(f"✗ inoutward_neft_api_log table not found: {e}")
logger.error(f"✗ outward_neft_api_log table not found: {e}")
raise SystemExit(
"FATAL: outward_neft_api_log table must be created manually before running this application"
)

137
logs/app.log
View File

@@ -195,3 +195,140 @@ Help: https://docs.oracle.com/error-help/db/ora-00001/
2026-03-13 18:11:31 - scheduler - INFO - No new files to process
2026-03-13 18:11:31 - sftp.sftp_client - INFO - SFTP connection closed
2026-03-13 18:11:31 - scheduler - INFO - Waiting 30 minutes until next cycle...
2026-03-13 22:53:49 - __main__ - INFO - Application started
2026-03-13 22:53:49 - config - WARNING - .env file not found. Using environment variables or defaults.
2026-03-13 22:53:49 - config - INFO - Configuration validated. Bank codes: 0001, 0002, 0003, 0004, 0005, 0006, 0007, 0009, 0012, 0013, 0014, 0015, 0016, 0017, 0018, 0020, 0021
2026-03-13 22:53:49 - scheduler - INFO - ================================================================================
2026-03-13 22:53:49 - scheduler - INFO - NEFT_OUTWARD File Processing Scheduler Started
2026-03-13 22:53:49 - scheduler - INFO - Poll Interval: 30 minutes
2026-03-13 22:53:49 - scheduler - INFO - Bank Codes: 0001, 0002, 0003, 0004, 0005, 0006, 0007, 0009, 0012, 0013, 0014, 0015, 0016, 0017, 0018, 0020, 0021
2026-03-13 22:53:49 - scheduler - INFO - ================================================================================
2026-03-13 22:53:49 - scheduler - INFO - Database connection test passed
2026-03-13 22:53:49 - db.repository - INFO - ✓ inoutward_neft_api_log table exists
2026-03-13 22:53:49 - db.repository - INFO - ✓ neft_processed_files table exists
2026-03-13 22:53:49 - db.repository - INFO - Database tables verified successfully
2026-03-13 22:53:49 - scheduler - INFO - === Starting processing cycle 1 ===
2026-03-13 22:53:49 - sftp.sftp_client - INFO - Connected to SFTP server: 43.225.3.224:4650
2026-03-13 22:53:49 - scheduler - INFO - listing file for 13032026
2026-03-13 22:53:49 - sftp.sftp_client - WARNING - Directory not found: /home/ipks/IPKS_FILES/REPORTS/0016/NEFT
2026-03-13 22:53:49 - scheduler - INFO - No new files to process
2026-03-13 22:53:49 - sftp.sftp_client - INFO - SFTP connection closed
2026-03-13 22:53:49 - scheduler - INFO - Waiting 30 minutes until next cycle...
2026-03-13 23:01:21 - __main__ - INFO - Application started
2026-03-13 23:01:21 - config - WARNING - .env file not found. Using environment variables or defaults.
2026-03-13 23:01:21 - config - INFO - Configuration validated. Bank codes: 0001, 0002, 0003, 0004, 0005, 0006, 0007, 0009, 0012, 0013, 0014, 0015, 0016, 0017, 0018, 0020, 0021
2026-03-13 23:01:21 - scheduler - INFO - ================================================================================
2026-03-13 23:01:21 - scheduler - INFO - NEFT_OUTWARD File Processing Scheduler Started
2026-03-13 23:01:21 - scheduler - INFO - Poll Interval: 30 minutes
2026-03-13 23:01:21 - scheduler - INFO - Bank Codes: 0001, 0002, 0003, 0004, 0005, 0006, 0007, 0009, 0012, 0013, 0014, 0015, 0016, 0017, 0018, 0020, 0021
2026-03-13 23:01:21 - scheduler - INFO - ================================================================================
2026-03-13 23:01:21 - scheduler - INFO - Database connection test passed
2026-03-13 23:01:21 - db.repository - INFO - ✓ outward_neft_api_log table exists
2026-03-13 23:01:21 - db.repository - INFO - ✓ neft_processed_files table exists
2026-03-13 23:01:21 - db.repository - INFO - Database tables verified successfully
2026-03-13 23:01:21 - scheduler - INFO - === Starting processing cycle 1 ===
2026-03-13 23:01:22 - sftp.sftp_client - INFO - Connected to SFTP server: 43.225.3.224:4650
2026-03-13 23:01:22 - scheduler - INFO - listing file for 13032026
2026-03-13 23:01:22 - scheduler - INFO - Found new file: 13032026_20_NEFT_OUTWARD.TXT (bank: 0001)
2026-03-13 23:01:22 - sftp.sftp_client - WARNING - Directory not found: /home/ipks/IPKS_FILES/REPORTS/0016/NEFT
2026-03-13 23:01:22 - scheduler - INFO - Found 1 new files to process
2026-03-13 23:01:22 - processors.file_processor - INFO - Starting processing: 13032026_20_NEFT_OUTWARD.TXT (bank: 0001)
2026-03-13 23:01:22 - sftp.sftp_client - INFO - Downloaded file: /home/ipks/IPKS_FILES/REPORTS/0001/NEFT/13032026_20_NEFT_OUTWARD.TXT -> /tmp/13032026_20_NEFT_OUTWARD.TXT
2026-03-13 23:01:22 - neft_outward_parser - INFO - Read 59 data rows using encoding utf-8-sig
2026-03-13 23:01:22 - neft_outward_parser - INFO - Parsed 59 rows from /tmp/13032026_20_NEFT_OUTWARD.TXT
2026-03-13 23:01:22 - processors.data_mapper - INFO - Mapped 59 NEFT transactions for bank 0001
2026-03-13 23:01:36 - db.repository - INFO - [{'TXNIND': 'DR', 'BANKCODE': '0001', 'JRNL_ID': '000480998', 'REF_NO': 'WBSCN26072518321', 'TRAN_DATE': '13032026', 'TXN_AMT': Decimal('86000'), 'SENDER_IFSC': 'WBSC0000019', 'RECIEVER_IFSC': 'HDFC0000240', 'SENDER_ACCT_NO': '00000101009825802', 'SENDER_NAME': 'NARAYAN KHUTIYA', 'RECVR_ACCT_NO': '00210190539105214', 'RECIEVER_NAME': '/00210190539105214 VISHAKHA IND LTD SURAT', 'REJECT_CODE': '', 'REJECT_REASON': '', 'BENEFICIARY_ADDRESS': 'SURAT', 'MSG_TYPE': 'N06', 'SENDER_TO_RECIVER_INFO': ' '}, {'TXNIND': 'DR', 'BANKCODE': '0001', 'JRNL_ID': '000482767', 'REF_NO': 'WBSCN26072518326', 'TRAN_DATE': '13032026', 'TXN_AMT': Decimal('50000'), 'SENDER_IFSC': 'WBSC0000036', 'RECIEVER_IFSC': 'ICIC0000914', 'SENDER_ACCT_NO': '00000101007965727', 'SENDER_NAME': 'REAJUL GAZI', 'RECVR_ACCT_NO': '091401512554', 'RECIEVER_NAME': '/091401512554 NARGIS GAZI BHEBIA', 'REJECT_CODE': '', 'REJECT_REASON': '', 'BENEFICIARY_ADDRESS': 'BHEBIA', 'MSG_TYPE': 'N06', 'SENDER_TO_RECIVER_INFO': ' '}, {'TXNIND': 'DR', 'BANKCODE': '0001', 'JRNL_ID': '000483054', 'REF_NO': 'WBSCN26072518329', 'TRAN_DATE': '13032026', 'TXN_AMT': Decimal('18500'), 'SENDER_IFSC': 'WBSC0000036', 'RECIEVER_IFSC': 'BKID0004277', 'SENDER_ACCT_NO': '00000101010810279', 'SENDER_NAME': 'REBEKA KHATUN', 'RECVR_ACCT_NO': '427710110000935', 'RECIEVER_NAME': '/427710110000935 FARUKUDDIN MONDAL MURARISA', 'REJECT_CODE': '', 'REJECT_REASON': '', 'BENEFICIARY_ADDRESS': 'MURARISA', 'MSG_TYPE': 'N06', 'SENDER_TO_RECIVER_INFO': ' '}, {'TXNIND': 'DR', 'BANKCODE': '0001', 'JRNL_ID': '000478794', 'REF_NO': 'WBSCN26072518288', 'TRAN_DATE': '13032026', 'TXN_AMT': Decimal('1500'), 'SENDER_IFSC': 'WBSC0000043', 'RECIEVER_IFSC': 'SBIN0000001', 'SENDER_ACCT_NO': '00000101008083608', 'SENDER_NAME': '', 'RECVR_ACCT_NO': '00000044999048314', 'RECIEVER_NAME': '', 'REJECT_CODE': '', 'REJECT_REASON': '', 'BENEFICIARY_ADDRESS': '', 'MSG_TYPE': 'N07', 'SENDER_TO_RECIVER_INFO': ' '}, {'TXNIND': 'DR', 'BANKCODE': '0001', 'JRNL_ID': '000478802', 'REF_NO': 'WBSCN26072518289', 'TRAN_DATE': '13032026', 'TXN_AMT': Decimal('1500'), 'SENDER_IFSC': 'WBSC0000043', 'RECIEVER_IFSC': 'SBIN0000001', 'SENDER_ACCT_NO': '00000101008107473', 'SENDER_NAME': '', 'RECVR_ACCT_NO': '00000044999048314', 'RECIEVER_NAME': '', 'REJECT_CODE': '', 'REJECT_REASON': '', 'BENEFICIARY_ADDRESS': '', 'MSG_TYPE': 'N07', 'SENDER_TO_RECIVER_INFO': ' '}]
2026-03-13 23:01:36 - db.repository - INFO - Inserted 5 NEFT transactions into outward_neft_api_log
2026-03-13 23:01:36 - db.repository - INFO - Marked file as processed: 13032026_20_NEFT_OUTWARD.TXT
2026-03-13 23:01:36 - processors.file_processor - INFO - Successfully processed 13032026_20_NEFT_OUTWARD.TXT: 5 inserted, 54 skipped (non-ipks accounts)
2026-03-13 23:01:36 - processors.file_processor - INFO - Processing complete: 1/1 successful
2026-03-13 23:01:36 - scheduler - INFO - Cycle 1 complete:
2026-03-13 23:01:36 - scheduler - INFO - Total files: 1
2026-03-13 23:01:36 - scheduler - INFO - Successful: 1
2026-03-13 23:01:36 - scheduler - INFO - Failed: 0
2026-03-13 23:01:36 - scheduler - INFO - Calling neft_api_txn_post procedure for all inserted transactions...
2026-03-13 23:01:36 - db.repository - INFO - Calling neft_api_txn_post procedure to process all inserted transactions...
2026-03-13 23:01:36 - db.repository - INFO - neft_api_txn_post procedure executed successfully
2026-03-13 23:01:36 - scheduler - INFO - Transaction post-processing completed successfully
2026-03-13 23:01:36 - sftp.sftp_client - INFO - SFTP connection closed
2026-03-13 23:01:36 - scheduler - INFO - Waiting 30 minutes until next cycle...
2026-03-13 23:31:37 - scheduler - INFO - === Starting processing cycle 2 ===
2026-03-13 23:31:37 - sftp.sftp_client - INFO - Connected to SFTP server: 43.225.3.224:4650
2026-03-13 23:31:37 - scheduler - INFO - listing file for 13032026
2026-03-13 23:31:37 - sftp.sftp_client - WARNING - Directory not found: /home/ipks/IPKS_FILES/REPORTS/0016/NEFT
2026-03-13 23:31:37 - scheduler - INFO - No new files to process
2026-03-13 23:31:37 - sftp.sftp_client - INFO - SFTP connection closed
2026-03-13 23:31:37 - scheduler - INFO - Waiting 30 minutes until next cycle...
2026-03-14 00:01:37 - scheduler - INFO - === Starting processing cycle 3 ===
2026-03-14 00:01:37 - sftp.sftp_client - INFO - Connected to SFTP server: 43.225.3.224:4650
2026-03-14 00:01:37 - scheduler - INFO - listing file for 14032026
2026-03-14 00:01:38 - sftp.sftp_client - WARNING - Directory not found: /home/ipks/IPKS_FILES/REPORTS/0016/NEFT
2026-03-14 00:01:38 - scheduler - INFO - No new files to process
2026-03-14 00:01:38 - sftp.sftp_client - INFO - SFTP connection closed
2026-03-14 00:01:38 - scheduler - INFO - Waiting 30 minutes until next cycle...
2026-03-14 00:31:38 - scheduler - INFO - === Starting processing cycle 4 ===
2026-03-14 00:31:38 - sftp.sftp_client - INFO - Connected to SFTP server: 43.225.3.224:4650
2026-03-14 00:31:38 - scheduler - INFO - listing file for 14032026
2026-03-14 00:31:38 - sftp.sftp_client - WARNING - Directory not found: /home/ipks/IPKS_FILES/REPORTS/0016/NEFT
2026-03-14 00:31:38 - scheduler - INFO - No new files to process
2026-03-14 00:31:38 - sftp.sftp_client - INFO - SFTP connection closed
2026-03-14 00:31:38 - scheduler - INFO - Waiting 30 minutes until next cycle...
2026-03-18 13:17:33 - __main__ - INFO - Application started
2026-03-18 13:17:33 - config - WARNING - .env file not found. Using environment variables or defaults.
2026-03-18 13:17:33 - config - INFO - Configuration validated. Bank codes: 0001, 0002, 0003, 0004, 0005, 0006, 0007, 0009, 0012, 0013, 0014, 0015, 0016, 0017, 0018, 0020, 0021
2026-03-18 13:17:33 - scheduler - INFO - ================================================================================
2026-03-18 13:17:33 - scheduler - INFO - NEFT_OUTWARD File Processing Scheduler Started
2026-03-18 13:17:33 - scheduler - INFO - Poll Interval: 30 minutes
2026-03-18 13:17:33 - scheduler - INFO - Bank Codes: 0001, 0002, 0003, 0004, 0005, 0006, 0007, 0009, 0012, 0013, 0014, 0015, 0016, 0017, 0018, 0020, 0021
2026-03-18 13:17:33 - scheduler - INFO - ================================================================================
2026-03-18 13:17:33 - scheduler - INFO - Database connection test passed
2026-03-18 13:17:33 - db.repository - INFO - ✓ outward_neft_api_log table exists
2026-03-18 13:17:33 - db.repository - INFO - ✓ neft_processed_files table exists
2026-03-18 13:17:33 - db.repository - INFO - Database tables verified successfully
2026-03-18 13:17:33 - scheduler - INFO - === Starting processing cycle 1 ===
2026-03-18 13:17:33 - sftp.sftp_client - INFO - Connected to SFTP server: 43.225.3.224:4650
2026-03-18 13:17:33 - scheduler - INFO - listing file for 18032026
2026-03-18 13:17:33 - scheduler - INFO - Found new file: 18032026_20_NEFT_OUTWARD.TXT (bank: 0005)
2026-03-18 13:17:33 - sftp.sftp_client - WARNING - Directory not found: /home/ipks/IPKS_FILES/REPORTS/0016/NEFT
2026-03-18 13:17:33 - scheduler - INFO - Found 1 new files to process
2026-03-18 13:17:33 - processors.file_processor - INFO - Starting processing: 18032026_20_NEFT_OUTWARD.TXT (bank: 0005)
2026-03-18 13:17:33 - sftp.sftp_client - INFO - Downloaded file: /home/ipks/IPKS_FILES/REPORTS/0005/NEFT/18032026_20_NEFT_OUTWARD.TXT -> /tmp/18032026_20_NEFT_OUTWARD.TXT
2026-03-18 13:17:33 - neft_outward_parser - INFO - Read 59 data rows using encoding utf-8-sig
2026-03-18 13:17:33 - neft_outward_parser - INFO - Parsed 59 rows from /tmp/18032026_20_NEFT_OUTWARD.TXT
2026-03-18 13:17:33 - processors.data_mapper - INFO - Mapped 59 NEFT transactions for bank 0005
2026-03-18 13:17:48 - db.repository - INFO - [{'TXNIND': 'DR', 'BANKCODE': '0005', 'JRNL_ID': '000480998', 'REF_NO': 'WBSCN26072518321', 'TRAN_DATE': '13032026', 'TXN_AMT': Decimal('86000'), 'SENDER_IFSC': 'WBSC0000019', 'RECIEVER_IFSC': 'HDFC0000240', 'SENDER_ACCT_NO': '00000101009825802', 'SENDER_NAME': 'NARAYAN KHUTIYA', 'RECVR_ACCT_NO': '00210190539105214', 'RECIEVER_NAME': '/00210190539105214 VISHAKHA IND LTD SURAT', 'REJECT_CODE': '', 'REJECT_REASON': '', 'BENEFICIARY_ADDRESS': 'SURAT', 'MSG_TYPE': 'N06', 'SENDER_TO_RECIVER_INFO': ' '}, {'TXNIND': 'DR', 'BANKCODE': '0005', 'JRNL_ID': '000482767', 'REF_NO': 'WBSCN26072518326', 'TRAN_DATE': '13032026', 'TXN_AMT': Decimal('50000'), 'SENDER_IFSC': 'WBSC0000036', 'RECIEVER_IFSC': 'ICIC0000914', 'SENDER_ACCT_NO': '00000101007965727', 'SENDER_NAME': 'REAJUL GAZI', 'RECVR_ACCT_NO': '091401512554', 'RECIEVER_NAME': '/091401512554 NARGIS GAZI BHEBIA', 'REJECT_CODE': '', 'REJECT_REASON': '', 'BENEFICIARY_ADDRESS': 'BHEBIA', 'MSG_TYPE': 'N06', 'SENDER_TO_RECIVER_INFO': ' '}, {'TXNIND': 'DR', 'BANKCODE': '0005', 'JRNL_ID': '000483054', 'REF_NO': 'WBSCN26072518329', 'TRAN_DATE': '13032026', 'TXN_AMT': Decimal('18500'), 'SENDER_IFSC': 'WBSC0000036', 'RECIEVER_IFSC': 'BKID0004277', 'SENDER_ACCT_NO': '00000101010810279', 'SENDER_NAME': 'REBEKA KHATUN', 'RECVR_ACCT_NO': '427710110000935', 'RECIEVER_NAME': '/427710110000935 FARUKUDDIN MONDAL MURARISA', 'REJECT_CODE': '', 'REJECT_REASON': '', 'BENEFICIARY_ADDRESS': 'MURARISA', 'MSG_TYPE': 'N06', 'SENDER_TO_RECIVER_INFO': ' '}, {'TXNIND': 'DR', 'BANKCODE': '0005', 'JRNL_ID': '000478794', 'REF_NO': 'WBSCN26072518288', 'TRAN_DATE': '13032026', 'TXN_AMT': Decimal('1500'), 'SENDER_IFSC': 'WBSC0000043', 'RECIEVER_IFSC': 'SBIN0000001', 'SENDER_ACCT_NO': '00000101008083608', 'SENDER_NAME': '', 'RECVR_ACCT_NO': '00000044999048314', 'RECIEVER_NAME': '', 'REJECT_CODE': '', 'REJECT_REASON': '', 'BENEFICIARY_ADDRESS': '', 'MSG_TYPE': 'N07', 'SENDER_TO_RECIVER_INFO': ' '}, {'TXNIND': 'DR', 'BANKCODE': '0005', 'JRNL_ID': '000478802', 'REF_NO': 'WBSCN26072518289', 'TRAN_DATE': '13032026', 'TXN_AMT': Decimal('1500'), 'SENDER_IFSC': 'WBSC0000043', 'RECIEVER_IFSC': 'SBIN0000001', 'SENDER_ACCT_NO': '00000101008107473', 'SENDER_NAME': '', 'RECVR_ACCT_NO': '00000044999048314', 'RECIEVER_NAME': '', 'REJECT_CODE': '', 'REJECT_REASON': '', 'BENEFICIARY_ADDRESS': '', 'MSG_TYPE': 'N07', 'SENDER_TO_RECIVER_INFO': ' '}]
2026-03-18 13:17:48 - db.repository - INFO - Inserted 5 NEFT transactions into outward_neft_api_log
2026-03-18 13:17:48 - db.repository - INFO - Marked file as processed: 18032026_20_NEFT_OUTWARD.TXT
2026-03-18 13:17:48 - processors.file_processor - INFO - Successfully processed 18032026_20_NEFT_OUTWARD.TXT: 5 inserted, 54 skipped (non-ipks accounts)
2026-03-18 13:17:48 - processors.file_processor - INFO - Processing complete: 1/1 successful
2026-03-18 13:17:48 - scheduler - INFO - Cycle 1 complete:
2026-03-18 13:17:48 - scheduler - INFO - Total files: 1
2026-03-18 13:17:48 - scheduler - INFO - Successful: 1
2026-03-18 13:17:48 - scheduler - INFO - Failed: 0
2026-03-18 13:17:48 - scheduler - INFO - Calling neft_api_txn_post procedure for all inserted transactions...
2026-03-18 13:17:48 - db.repository - INFO - Calling neft_api_txn_post procedure to process all inserted transactions...
2026-03-18 13:17:48 - db.repository - INFO - neft_api_txn_post procedure executed successfully
2026-03-18 13:17:48 - scheduler - INFO - Transaction post-processing completed successfully
2026-03-18 13:17:48 - sftp.sftp_client - INFO - SFTP connection closed
2026-03-18 13:17:48 - scheduler - INFO - Waiting 30 minutes until next cycle...
2026-03-18 13:47:48 - scheduler - INFO - === Starting processing cycle 2 ===
2026-03-18 13:47:48 - sftp.sftp_client - INFO - Connected to SFTP server: 43.225.3.224:4650
2026-03-18 13:47:48 - scheduler - INFO - listing file for 18032026
2026-03-18 13:47:49 - sftp.sftp_client - WARNING - Directory not found: /home/ipks/IPKS_FILES/REPORTS/0016/NEFT
2026-03-18 13:47:49 - scheduler - INFO - No new files to process
2026-03-18 13:47:49 - sftp.sftp_client - INFO - SFTP connection closed
2026-03-18 13:47:49 - scheduler - INFO - Waiting 30 minutes until next cycle...
2026-03-18 14:17:49 - scheduler - INFO - === Starting processing cycle 3 ===
2026-03-18 14:17:49 - sftp.sftp_client - INFO - Connected to SFTP server: 43.225.3.224:4650
2026-03-18 14:17:49 - scheduler - INFO - listing file for 18032026
2026-03-18 14:17:49 - sftp.sftp_client - WARNING - Directory not found: /home/ipks/IPKS_FILES/REPORTS/0016/NEFT
2026-03-18 14:17:49 - scheduler - INFO - No new files to process
2026-03-18 14:17:49 - sftp.sftp_client - INFO - SFTP connection closed
2026-03-18 14:17:49 - scheduler - INFO - Waiting 30 minutes until next cycle...
2026-03-18 14:47:49 - scheduler - INFO - === Starting processing cycle 4 ===
2026-03-18 14:47:49 - sftp.sftp_client - INFO - Connected to SFTP server: 43.225.3.224:4650
2026-03-18 14:47:49 - scheduler - INFO - listing file for 18032026
2026-03-18 14:47:49 - sftp.sftp_client - WARNING - Directory not found: /home/ipks/IPKS_FILES/REPORTS/0016/NEFT
2026-03-18 14:47:50 - scheduler - INFO - No new files to process
2026-03-18 14:47:50 - sftp.sftp_client - INFO - SFTP connection closed
2026-03-18 14:47:50 - scheduler - INFO - Waiting 30 minutes until next cycle...

BIN
processors/__pycache__/data_mapper.cpython-39.pyc
View File

Binary file not shown.

BIN
processors/__pycache__/file_processor.cpython-39.pyc
View File

Binary file not shown.