SmartsIntegrator Support and Discussion Forums

Forum Topics > General Pre-sales Support > Is it possible to not save the receiving files to the DB > Post a Reply to this Thread

Is it possible to not save the receiving files to the DB

Share/Bookmark: Add this Thread to Digg Digg   Add this Thread to StumbleUpon Stumble Upon   Add this Thread to Del.icio.us Del.icio.us   Add this Thread to Reddit Reddit   Add this Thread to Facebook Facebook
RE: Is it possible to not save the receiving files to the DB
by benj on Fri, Aug 7 2009 10:01 PM
Hi,

Thanks for your query.

The messages will be flagged for deletion fom the database once all references are removed, this may take up to 24 hours. The database will not grow indefinitely if tracking information is not stored, only current and recent messages are maintained.

Large messages (up to 4GB) are supported, but your server should be 64-bit and will require a significant amount of memory (8GB+, ideally 16GB). In this configuration you will not receive out of memory errors.

As a rough guide, assume each processor core will be handling 10 messages simultaneously and will store 2 transient copies of each message (regardless of the actual throughput rate, as garbage collection in the .Net layer smoothes this out). If each message is for example on average 100MB, and you have a quad-core processor, you should populate the server with 100 * 4 * 10 * 2 = 8GB of RAM in addition to that required for the o/s and other applications. If SQLServer is running on the same machine, add 50% more.

Luckily these days RAM is cheap!

Thanks,

Ben.
Ben Jackson
SmartsIntegrator Technical Support
benj
benj
Joined: Thu, Feb 7 2008
Posts: 96
Is it possible to not save the receiving files to the DB
by mneupane on Fri, Aug 7 2009 6:20 PM

Hi ..

I'm building a proof of concept work flow process using this tool (to determine if this tool meets our needs). I've build a simple workflow which copies files from one location to another, and logs the processed file names to a custom database, with time stamp (for audit purposes)

One of the things i've noticed is that the messaging database also keeps the files that are being processed within the smarts integrator database. After running couple of large file copying tests

- The smartsintegrator database is over 500 megs.
- Memory errors occur when processing large files ( 130 megs ).

Is this something that can be done to get around these two issue ?

Please note, for the "Receiving Ports" and "Send Ports" i've turned off all of the settings for "Tracking & Diagnostics".

Thanks

Manish
mneupane
Joined: Thu, Aug 6 2009
Location: Edmonton
Posts: 3