Best solution for Big Dataset search and then making "Statement of Account sheet" for each record
Results 1 to 3 of 3

Thread: Best solution for Big Dataset search and then making "Statement of Account sheet" for each record
Thanks Thanks: 0 Likes Likes: 0

  1. #1
    Board Regular
    Join Date
    Jul 2016
    Location
    Dubai
    Posts
    106
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Default Best solution for Big Dataset search and then making "Statement of Account sheet" for each record

    Hello Everybody,
    I am myself an excel VBA programmer as well as programmer in other languages i.e. Java, JavaScript, Python and C++. Currently I got a project where I have a huge dataset (more than 20,000 records spread over 25 columns) and not only that I have to search each record, I have to actually make a "Statement of Account" for each UNIQUE record. I already have made the full code and it works fine but my problem is that for such a huge data-set its super super slow. This is for obvious reasons as the code has to not only search through entire record but then create a NEW statement of account sheet for each record (which is quite CPU intensive task) and not something excel is good to handle. Can any expert person recommend me any alternate solution using SQL databases (I can shift my data to SQL) and then using some other software i.e. Python or Java to make the final result sheets or layouts. Excel is good for many things but i believe when data gets bigger than certain size then Excel isn't the most suitable solution and Databases should be the right solution.
    Any suggestions / ideas are welcome.

  2. #2
    Board Regular sandy666's Avatar
    Join Date
    Oct 2015
    Posts
    2,671
    Post Thanks / Like
    Mentioned
    27 Post(s)
    Tagged
    1 Thread(s)

    Default Re: Best solution for Big Dataset search and then making "Statement of Account sheet" for each record

    maybe PowerBi.
    I can't say more because I don't like PBI but you can try
    I know you know but I forgot my Crystal Ball and don't know what you know



    In the first post, show the type of machine (PC / Mac) and the Office version you are working on
    impossible things we do on the spot. for miracles you need to wait for a while

  3. #3
    Board Regular
    Join Date
    Jul 2016
    Location
    Dubai
    Posts
    106
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Default Re: Best solution for Big Dataset search and then making "Statement of Account sheet" for each record

    Since then I've been looking into PowerBI. Only issue being no support of VBA up till now. But hopefully its gonna help me reduce the search time considerably.

Some videos you may like

User Tag List

Tags for this Thread

Like this thread? Share it with others

Like this thread? Share it with others

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •