CiviCRM Community Forums (archive)

*

News:

Have a question about CiviCRM?
Get it answered quickly at the new
CiviCRM Stack Exchange Q+A site

This forum was archived on 25 November 2017. Learn more.
How to get involved.
What to do if you think you've found a bug.



  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Developer Discussion »
  • Google Summer of Code »
  • Gsoc 2016 - Fuzz Testing
Pages: [1] 2

Author Topic: Gsoc 2016 - Fuzz Testing  (Read 1716 times)

eugene23

  • I’m new here
  • *
  • Posts: 12
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Wordpress
  • MySQL version: 5.5.47
  • PHP version: 5.6.19
Gsoc 2016 - Fuzz Testing
March 16, 2016, 07:14:57 am
Hello Everyone,
                     After discussing with the mentor on the integration of mosaico with CiviCRM who told me it is no longer an idea , I may like to reiterate that i would like to work on the testing project as i need this on my final project by the end of this year and also as It may sound pleasing that i apply the knowledge i acquired in order to bring this project to completion.

Among the ideas, i got interested on  Fuzzy Testing.
 
 With the research skills i have i took it upon myself to go ahead with the aim of the project idea. Already i have gone through the following as i arrange them below;

  **  Testing
                         - identified what kind of testing is needed for the project
                         - reviewed many static techniques and dynamic testing techniques
           
       *** testing techniques
                         - the probable testing technique suitable and the reasons for them being chosen as important
                         - looked at if there is a posibility if the chosen technique is generally a good one and if it matches the the quality assurance team of CiviCRM 
       
       **** Dynamic Testing
                         - Black-Box Testing
                         - Whte-Box Testing
I therefore think have knowledge on functional testing and non-functional testing to take care of the quality assurance issues of CiviCRM

Currently I am working on the possibly tools and frameworks which could be used to address most of the aims of the project idea and i have stumbled on one popular one and i have made some research on it but i need probably to clarify myself on some issues before i continue with writing the proposal for this project.

I will be glad if i could discuss this with the proposed mentor @totten so i can sharpen these ideas and complete my proposal and submit before the deadline

Thanks for your humble response in advance

Eugene
 

 
« Last Edit: March 21, 2016, 08:05:20 am by eugene23 »

eugene23

  • I’m new here
  • *
  • Posts: 12
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Wordpress
  • MySQL version: 5.5.47
  • PHP version: 5.6.19
Re: Gsoc 2016 - Fuzzy Testing
March 20, 2016, 02:01:22 pm
    Hello @totten,
                                 based on our discussion, i made further looks and i have gone through though briefly through another platform which we could use to do the fuzz testing though there are some string tied around it but i belief after such questions like those which You asked me the other time it will refine the ideas around the scope which i have to work.


So why I round up with the proposed fuzz platform idea for CiviCRM, I humbly request u raise some questions which i will use to do more evaluation on the framework a few of which i have evaluated

-- It is automated
-- it is easy to use
-- it is feasible for webapp testing

about if it can be integrated that i will figure out as part of the Gsoc project and also add it to the timeline of the projcet

Regards
eugene

xavier

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4453
  • Karma: 161
    • Tech To The People
  • CiviCRM version: yes probably
  • CMS version: drupal
Re: Gsoc 2016 - Fuzzy Testing
March 20, 2016, 02:21:07 pm
What plateform did you look at?
-Hackathon and data journalism about the European parliament 24-26 jan. Watch out the result

eugene23

  • I’m new here
  • *
  • Posts: 12
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Wordpress
  • MySQL version: 5.5.47
  • PHP version: 5.6.19
Re: Gsoc 2016 - Fuzzy Testing
March 20, 2016, 02:33:22 pm
i looked at https://github.com/OpenRCE/sulley

mesode

  • I’m new here
  • *
  • Posts: 9
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Drupal
  • MySQL version: 5.6.28
  • PHP version: 5.6.11
Re: Gsoc 2016 - Fuzzy Testing
March 20, 2016, 05:12:20 pm
Hi Eugene,
                      Just going through the discussion threads now and realize we're working on thesame project idea. I have also been doing some research on the topic and I also stumble on Sulley, but further research reveals that Sulley’s latest release is buggy and has fallen out of maintenance to say the least.

I came up with these four :-
1. WebScarab
2. JBroFuzz
3. boofuzz
4. Peach Fuzzing Platform (though I still have some reservations here due it corporate nature support)
You can also take a look at them and then let's see if we can come up with something better.  Also do you think developing a our own CiviCRM fuzzy testing framework form scratch is feasible??

Regards
mesode

eugene23

  • I’m new here
  • *
  • Posts: 12
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Wordpress
  • MySQL version: 5.5.47
  • PHP version: 5.6.19
Re: Gsoc 2016 - Fuzzy Testing
March 21, 2016, 12:20:09 am
Hi Mesode,
                     I have gone through 5 fuzzing platforms including WebScarab, Peach and JbroFuz , what they do and their ease of use and integration, and based on the criteria of evaluation a *nix version of sulley framework its advantages amongst about 10 platforms i visited and evaluated, therefore  i think taking the sulley framework is a great idea but entails making a *nix version and deploying a stable version and making it work which i think is possible

the documentation of Peach is very poor and it is not easy to use

So far before i go to use any of these platform to see how they really work and the results they produce

Concerning the feasibility of designing CiviCRM testing framework, i say it is possible if the functionality and workability of a *fuzzer* is known

So far I evaluate Sulley as the best of all the tools i have come across. Hope all of these make sense

Regards
eugene23

mesode

  • I’m new here
  • *
  • Posts: 9
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Drupal
  • MySQL version: 5.6.28
  • PHP version: 5.6.11
Re: Gsoc 2016 - Fuzzy Testing
March 21, 2016, 02:36:12 am
Hi Eugene,

<<So far I evaluate Sulley as the best of all the tools i have come across.>>
That should only be as far as you have gone with your research. I will also like you to take a look at this. https://github.com/jtpereyda/boofuzz.
I am sure you will be able see why I write Sulley off!

cheers
mesode


xavier

  • Forum Godess / God
  • I’m (like) Lobo ;)
  • *****
  • Posts: 4453
  • Karma: 161
    • Tech To The People
  • CiviCRM version: yes probably
  • CMS version: drupal
Re: Gsoc 2016 - Fuzzy Testing
March 21, 2016, 06:05:39 am
Did you check with the projects if they think it would fit?

Ideally, we'd have a co-mentor coming from that project, could you probe if there is an interest on their side?
-Hackathon and data journalism about the European parliament 24-26 jan. Watch out the result

eugene23

  • I’m new here
  • *
  • Posts: 12
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Wordpress
  • MySQL version: 5.5.47
  • PHP version: 5.6.19
Re: Gsoc 2016 - Fuzzy Testing
March 21, 2016, 06:39:16 am
Hi Mesode, xavier,
                       Thanks for your proposition, I seem to like foobuzz  because it was forked and customized from the sulley testing framework and it addresses most of these issues which sulley fails to address like installation and use though it still has little documentation on *nix environments though it still references sulley in its documentation and also has very little on its getting started. but OVERALL IT IS BETTER THAN SULLEY.

Xavier: i have contacted Joshua to check if they think it will fit and many other questions as concerning the use of their framework

Cheers
eugene

mesode

  • I’m new here
  • *
  • Posts: 9
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Drupal
  • MySQL version: 5.6.28
  • PHP version: 5.6.11
Re: Gsoc 2016 - Fuzz Testing
March 21, 2016, 08:28:04 am
Yes, I have contacted Joshua Pereyda who is leading the boofuzz project. Still waiting for his feedbacks. From what he will say, then we will be able to determine if there could be interested in co-mentoring the project. While waiting for Joshua's reply, we will still be exploring other posibilities.

cheers
mesode
« Last Edit: March 21, 2016, 01:29:28 pm by mesode »

eugene23

  • I’m new here
  • *
  • Posts: 12
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Wordpress
  • MySQL version: 5.5.47
  • PHP version: 5.6.19
Re: Gsoc 2016 - Fuzz Testing
March 21, 2016, 09:19:18 am
Hi Mesode, 
                     I wish to ask to what extent you have gone with the boofuzz platform and if at all you have gone past research " i mean like trying to use the platform"
I have tried and i have so many difficulties so i propose that while waiting on Joshua It will be important to see if we can analyze the process behind the functioning of fuzz testing of webapps so if it comes out that it be utmost to bring up one we will quickly do that.

I am still into exploring more of foobuzz but already it has many dependencies which i am trying to figure how to install but i do believe that ff Joshua replies he might have a better way to make the whole issue understandable

while i continue with more on exploring i will propose u do the same and let us see how this can be done.

Regards
Eugene

mesode

  • I’m new here
  • *
  • Posts: 9
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Drupal
  • MySQL version: 5.6.28
  • PHP version: 5.6.11
Re: Gsoc 2016 - Fuzz Testing
March 21, 2016, 02:32:52 pm

What exactly is difficulty you are having?
For installing just follow the instructions here https://github.com/jtpereyda/boofuzz/blob/master/INSTALL.rst
And then you can use this https://www.securepla.net/fuzzing-101-with-sulley/ as a baseline to get you started.

cheers
mesode

eugene23

  • I’m new here
  • *
  • Posts: 12
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Wordpress
  • MySQL version: 5.5.47
  • PHP version: 5.6.19
Re: Gsoc 2016 - Fuzz Testing
March 22, 2016, 03:37:54 am
Hi Mesode,
                     I am using an ubuntu system and i succesfully installed boofuzz using pip ans stated in https://github.com/jtpereyda/boofuzz/blob/master/INSTALL.rst and i had to check out what boofuz is composed of and the various python scripts which are written on the framework and i stumbbled on some fuzz examples in the examples folder so i understood the examples and what they do, so i  edited them to run a sample and the stack trace what i did  i have pasted here  http://pastebin.com/fHpGgf0b    . seems you have gone through the framework, installed and used it so i wish you can explain to me what is wrong from the paste i made on pastebin.com . I suggest you give ur IRC nick and tell me when to meet you on the channel so we can chat faster. Waiting on you soonest

Regards
Eugene
« Last Edit: March 22, 2016, 03:47:22 am by eugene23 »

mesode

  • I’m new here
  • *
  • Posts: 9
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Drupal
  • MySQL version: 5.6.28
  • PHP version: 5.6.11
Re: Gsoc 2016 - Fuzz Testing
March 22, 2016, 03:12:19 pm
Did you follow every step in the tutorial?
My IRC id is mesode
I'm on now, you can just leave a private message there I will see it

eugene23

  • I’m new here
  • *
  • Posts: 12
  • Karma: 0
  • CiviCRM version: 4.7.3
  • CMS version: Wordpress
  • MySQL version: 5.5.47
  • PHP version: 5.6.19
Re: Gsoc 2016 - Fuzz Testing
March 23, 2016, 04:47:29 am
Hi Mesode,
                      Do u understand python very well because i do understand , I got your IRC nick and i will get to you on IRC. But fortunately for me you didn't speak about the stack i pasted on pastebin. While waiting on Joshua I will continue to explore the Framework and look forward to solve the issues i have. Please if you do have experience in python and have a walk around the platform do well to help me with the issues i have.

Regards
Eugene

Pages: [1] 2
  • CiviCRM Community Forums (archive) »
  • Old sections (read-only, deprecated) »
  • Developer Discussion »
  • Google Summer of Code »
  • Gsoc 2016 - Fuzz Testing

This forum was archived on 2017-11-26.