Some custom groups not available in Views

[Tiffani Chin]

I thought that this problem had disappeared but -- even with the patch above applied -- they still disappear from time to time. 

Declining the changes in views and then clearing caches does seem to bring them back.

Has anyone learned any more on what causes this?
Thanks!

[Chasen]

For me (touch wood) since I enabled anonymous caching I've not had the fields drop (patch is also applied from this thread)

I'm half living in fear expecting it to but it's been ~1 month now and no fields drop yet.

I was able to take a full copy of the site which I've put into a dev site for testing when I last did maintenance so I'll do some testing to see if I can identify anything more specific for you.

[Tiffani Chin]

Chasen,

I have a theory that I haven't tested well, but I'm keeping an eye on it.
With caching on, the patch applied, and 4.2 installed, the Views stay put much better.  But they still sometimes disappear.

I'm thinking it may happen when I mess with the view in some other way (or, perhaps when I mess with any view on the site?).  It doesn't seem to happen immediately.  But I see a correlation between me tweaking some part of the view and then all of the custom fields disappearing shortly thereafter.

This may be pure coincidence, but I thought I would throw it out there.

Please post if you learn anything!
-tiffani

[Chasen]

Hi Tiffany,

Just thought I'd update you, I did a full maintenance for my website on Friday last week for about 3 hours editing/updating various views, including numerous module/security and other updates, without any issue.

It seems that disabling anon caching can make these fields disappear but re-enabling the caching makes them come back instantly. With anon caching enabled, I can edit any/all my views without them dropping any more - I've even tried flushing the caches while in the middle of editing a view just to see if that would break it but it didn't.

Since I first enabled the anon caching (after previously trying all the other fixes suggested in this thread) I've not had any issues and it's been about 5 weeks now without any lost custom fields including 2 maintenance periods (one of which, this Friday's),being a major maintenance where I edited/changed about 6 different views).

All systems running hot, straight and normal for me so far.

As I know how frustrating this was for me, let me know if you require any more info/help and I'll try to assist you as best I can

Thanks,
Chris

[Chasen]

So, unfortunately, my views broke again today

At the time of the edit I was doing two things:
I was VIEWING (not editing) my list of custom fields in CiviCRM; and
I was editing a view where the CiviCRM custom field was being used as an exposed filter and one of the custom fields wasn't checked in the list of available options for the filter so I clicked "select all" at the top of the list of fields available to the filter and then unchecked "limit list to selected items" and then clicked save

The next time I loaded the page with the search table on it, it was all haywire with neither of my exposed filters (both custom CiviCRM fields) showing up. When i went into the View it straight away gave me the missing relationships/fields have been updated message and then all my custom CiviCRM fields from all views were lost....

If anyone's able to shed some light on this (or request of me more info and I will give you whatever I can) so that we can get this sorted that would be greatly appreciated.

EDIT: So i was clicking around in a few of the views, and I saw the "missing relationships/fields have been updated" message and I did what Tiffani suggested: cancelled the automatic changes and then flushed the cache and all my fields came back...

So I guess we can confirm it's related to caching however the aforementioned patch (which I have applied) doesn't seem to resolve the issue completely

[petednz]

did clearing caches have any effect on the View once you spotted the problem had occured again?

[Chasen]

Sorry, I updated my post with an EDIT but you were too quick!

Yes, when I first saw the missing relationships/changes have been made message I saved the changes. I then browsed around to a few of my other views that I know have custom fields and on the 3rd one I viewed I again saw the missing relationships messaged, so I cancelled the changes and then flushed all caches and ALL custom fields returned to normal (including the first view where I'd SAVED the changes)

At the moment, all custom fields are viewable but without knowing what's triggering this issue I don't know how long they will last.

On a side note, how can I see which sub-sub version of CiviCRM I'm running? My modules page says I'm running 4.2 but I can't see what 4.2.x version I'm running as I've noticed that the latest version 4.2.8 is out and I wanted to go through the change logs in the versions between mine and the current to see if anything's been implemented in live related to these caching issues (so I'm not beating a dead horse if a newer version has a permanent bug fix already in place)

EDIT: Nevermind re: version number, its in the footer of the CiviCRM pages. Am running 4.2.6

[petednz]

So is it helpful to make it clear to others if they hit this problem - CLEAR DRUPAL CACHES ?

Would be worth getting on to 4.2.8 as there have been a couple of views patches i believe

[Chasen]

Absolutely. Tiffani's method is what I followed:

1. You notice that the page your view results is shown on has changed/broken (i.e. for me, my search table page has 5 fields: 3 from drupal and 2 from CiviCRM custom groups and I notice there's a problem because 2 of the 5 fields are missing)
2. You browse to the view itself (/admin/structure/views/view/<viewname>) and you get a message warning about 'missing relationships' and the view has automatically been updated with the missing relationships removed
3. You click CANCEL (rejecting the automatic changes)
4. You flush all caches (I use admin menu so for me it's Drupal menu > FLUSH ALL CACHES [note: i do not believe this flushes views cache])

Your fields should then return to normal.

At least, this process worked for me. Will update to 4.2.8 shortly and update with results.

[man4mac]

Absolutely. Tiffani's method is what I followed:

1. You notice that the page your view results is shown on has changed/broken (i.e. for me, my search table page has 5 fields: 3 from drupal and 2 from CiviCRM custom groups and I notice there's a problem because 2 of the 5 fields are missing)
2. You browse to the view itself (/admin/structure/views/view/<viewname>) and you get a message warning about 'missing relationships' and the view has automatically been updated with the missing relationships removed
3. You click CANCEL (rejecting the automatic changes)
4. You flush all caches (I use admin menu so for me it's Drupal menu > FLUSH ALL CACHES [note: i do not believe this flushes views cache])

Your fields should then return to normal.

At least, this process worked for me. Will update to 4.2.8 shortly and update with results.

Thanks for this detailed approach, I kept clearing caches with no effect, but I hadn't clicked the "Cancel" button on the views missing relationships message. After doing that, all my custom fields were back. However I can confirm this same bug is happening with my install of Drupal 7.17 + CiviCRM 4.2.6 + Views 3.5. They randomly seem to drop in and out. Relevant to this thread, I do have caching turned on for anonymous users. This seems to be a fairly critical bug, is there an official issue open for it?

[jtbayly]

I just ran into this same thing in CiviCRM 4.3.3 and Drupal 7.22 and Views 3.7. None of my custom fields were available in a brand new view I was creating. Flushing all caches and then trying again to create my new view fixed the problem. Should I file a bug report, or is there already an issue for this? Anybody know?

[Jon-man]

hi,

Not sure where this one is up to as there has been no response but we've had the same issue on a new site.
Drupal 7.28, CiviCRM 4.4.4

Two views with custom data broke, the custom data went missing and we had the message "This view has been automatically updated to fix missing relationships". The only thing we can think of is that we were working on other views. Not a nice issue to have, but we checked all the custom data remained in CiviCRM, it just disappeared from the Drupal View, unable to add it back in!

Solution was to cancel the automated changes to those views and clear the views cache in admin/structure/views/settings/advanced

 
Jon-man