Nov 02 09:55:32 devstack cinder-volume[75891]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 02 09:55:32 devstack cinder-volume[75891]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 02 09:55:32 devstack cinder-volume[75891]: we strongly recommend against using it for new projects.
Nov 02 09:55:32 devstack cinder-volume[75891]: If you are already using Eventlet, we recommend migrating to a different
Nov 02 09:55:32 devstack cinder-volume[75891]: framework.  For more detail see
Nov 02 09:55:32 devstack cinder-volume[75891]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 02 09:55:32 devstack cinder-volume[75891]:   import eventlet  # noqa
Nov 02 09:55:36 devstack cinder-volume[75891]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 02 09:55:36 devstack cinder-volume[75891]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 02 09:55:36 devstack cinder-volume[75891]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 02 09:55:37 devstack cinder-volume[75891]: INFO dbcounter [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Registered counter for database cinder
Nov 02 09:55:37 devstack cinder-volume[75891]: DEBUG oslo_db.sqlalchemy.engines [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 09:55:37 devstack cinder-volume[75891]: DEBUG dbcounter [-] [75891] Writer thread running {{(pid=75891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 02 09:55:37 devstack cinder-volume[75891]: INFO cinder.rpc [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 02 09:55:37 devstack cinder-volume[75891]: INFO cinder.rpc [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 02 09:55:37 devstack cinder-volume[75891]: DEBUG oslo_db.sqlalchemy.engines [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 09:55:37 devstack cinder-volume[75891]: INFO cinder.volume.manager [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Determined volume DB was empty at startup.
Nov 02 09:55:37 devstack cinder-volume[75891]: DEBUG cinder.volume.manager [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75891) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 02 09:55:37 devstack cinder-volume[75891]: INFO cinder.volume.manager [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 02 09:55:37 devstack cinder-volume[75891]: WARNING stevedore.named [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 02 09:55:37 devstack cinder-volume[75891]: WARNING castellan.key_manager [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 02 09:55:37 devstack cinder-volume[75891]: WARNING cinder.keymgr.conf_key_mgr [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 02 09:55:37 devstack cinder-volume[75891]: DEBUG cinder.volume.drivers.lvm [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75891) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 02 09:55:37 devstack cinder-volume[75891]: DEBUG oslo_concurrency.processutils [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_concurrency.processutils [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.554s {{(pid=75891) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_db.sqlalchemy.engines [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 09:55:38 devstack cinder-volume[75891]: INFO cinder.rpc [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 02 09:55:38 devstack cinder-volume[75891]: INFO cinder.rpc [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 02 09:55:38 devstack cinder-volume[75891]: WARNING stevedore.named [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 02 09:55:38 devstack cinder-volume[75891]: WARNING castellan.key_manager [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 02 09:55:38 devstack cinder-volume[75891]: INFO cinder.volume.manager [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_db.sqlalchemy.engines [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 09:55:38 devstack cinder-volume[75891]: INFO oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Starting 1 workers
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Started child 76047 {{(pid=75891) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Full set of CONF: {{(pid=75891) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] ******************************************************************************** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Configuration options gathered from: {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] ================================================================================ {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] allow_availability_zone_fallback = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] allow_compression_on_image_upload = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] allowed_direct_url_schemes     = [] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[76047]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] api_rate_limit                 = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] auth_strategy                  = keystone {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] az_cache_duration              = 3600 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_availability_zone      = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_host                   = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_name                   = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_stats_polling_interval = 60 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backup_api_class               = cinder.backup.api.API {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backup_name_template           = backup-%s {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backup_use_same_host           = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backup_use_temp_snapshot       = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] chap_password                  = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] chap_username                  =  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cinder_internal_tenant_project_id = 932430305d7e4af7acefed48f1484611 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cinder_internal_tenant_user_id = 8e33838613f94e87a92bb60001e538fb {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cloned_volume_same_az          = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cluster                        = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] compression_format             = gzip {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] config_dir                     = [] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] config_source                  = [] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] control_exchange               = openstack {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] debug                          = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] default_availability_zone      = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] default_group_type             = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] default_volume_type            = lvmdriver-1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] disk_geometry                  = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] driver_client_cert             = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] driver_client_cert_key         = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] driver_data_namespace          = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] driver_ssl_cert_path           = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] driver_ssl_cert_verify         = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] driver_use_ssl                 = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] enable_force_upload            = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] enable_new_services            = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] enable_unsupported_driver      = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] enforce_multipath_for_image_xfer = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] filter_function                = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance_api_insecure            = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance_api_servers             = ['http://192.168.122.143/image'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance_api_ssl_compression     = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance_ca_certificates_file    = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance_certfile                = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance_keyfile                 = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance_num_retries             = 3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance_request_timeout         = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] goodness_function              = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] graceful_shutdown_timeout      = 5 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] group_api_class                = cinder.group.api.API {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] host                           = devstack {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_compress_on_upload       = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_conversion_address_space_limit = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_conversion_cpu_limit     = 60 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_conversion_disable       = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_introspection_address_space_limit = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_introspection_cpu_limit  = 60 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_upload_use_cinder_backend = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_upload_use_internal_tenant = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_volume_cache_enabled     = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_volume_cache_max_count   = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] image_volume_cache_max_size_gb = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] init_host_max_objects_retrieval = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] iscsi_target_flags             =  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] iscsi_write_cache              = on {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] iser_helper                    = tgtadm {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] iser_ip_address                = 192.168.122.143 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] iser_port                      = 3260 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] log_color                      = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[76047]: INFO cinder.volume.manager [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 02 09:55:38 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] log_config_append              = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] log_dir                        = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] log_file                       = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] log_options                    = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] log_rotate_interval            = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] log_rotate_interval_type       = days {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] log_rotation_type              = none {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] max_age                        = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] max_logfile_count              = 30 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] max_logfile_size_mb            = 200 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] max_over_subscription_ratio    = 20.0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] message_reap_interval          = 86400 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] message_ttl                    = 2592000 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] migration_create_volume_timeout_secs = 300 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] monkey_patch                   = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] monkey_patch_modules           = [] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] my_ip                          = 192.168.122.143 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] no_snapshot_gb_quota           = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] num_iser_scan_tries            = 3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] num_shell_tries                = 3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] num_volume_device_scan_tries   = 3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] nvmeof_conn_info_version       = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] nvmet_ns_id                    = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] nvmet_port_id                  = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] osapi_max_limit                = 1000 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] osapi_volume_ext_list          = [] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] osapi_volume_listen_port       = 8776 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] osapi_volume_use_ssl           = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] osapi_volume_workers           = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] per_volume_size_limit          = -1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] periodic_fuzzy_delay           = 60 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] periodic_interval              = 60 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] public_endpoint                = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] publish_errors                 = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] quota_backup_gigabytes         = 1000 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] quota_backups                  = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] quota_gigabytes                = 1000 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] quota_groups                   = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] quota_snapshots                = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] quota_volumes                  = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] rate_limit_burst               = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] rate_limit_except_level        = CRITICAL {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] rate_limit_interval            = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] reinit_driver_count            = 3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] replication_device             = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] report_discard_supported       = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] report_interval                = 120 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] reservation_clean_interval     = 86400 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] reservation_expire             = 86400 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] reserved_image_namespaces      = [] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] reserved_percentage            = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] rpc_response_timeout           = 120 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] run_external_periodic_tasks    = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] scst_target_driver             = iscsi {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] scst_target_iqn_name           = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_down_time              = 720 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] shell_completion               = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] snapshot_name_template         = snapshot-%s {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] snapshot_same_host             = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] split_loggers                  = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] state_path                     = /opt/stack/data/cinder {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] storage_availability_zone      = nova {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] storage_protocol               = iSCSI {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] syslog_log_facility            = LOG_USER {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] target_helper                  = lioadm {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] target_ip_address              = 192.168.122.143 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] target_port                    = 3260 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] target_protocol                = iscsi {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] target_secondary_ip_addresses  = [] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] trace_flags                    = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] transport_url                  = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] until_refresh                  = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] use_chap_auth                  = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] use_default_quota_class        = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] use_journal                    = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] use_json                       = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] use_multipath_for_image_xfer   = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] use_stderr                     = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] use_syslog                     = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] verify_glance_signatures       = enabled {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_api_class               = cinder.volume.api.API {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_backend_name            = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_clear                   = zero {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_clear_ionice            = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_clear_size              = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_copy_bps_limit          = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_dd_blocksize            = 1M {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_name_template           = volume-%s {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_service_inithost_offload = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volume_usage_audit_period      = month {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] zoning_mode                    = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_concurrency.disable_process_locking = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.auth_section = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.auth_type   = password {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.auth_version = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.cache       = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.certfile    = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.include_service_catalog = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.insecure    = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.interface   = public {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.keyfile     = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_password = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcache_username = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.region_name = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.service_type = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.143/identity {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.backend                  = dogpile.cache.null {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.backend_argument         = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.backend_expiration_time  = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.config_prefix            = cache.oslo {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.debug_cache_backend      = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.enable_retry_client      = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.enable_socket_keepalive  = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.enabled                  = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.expiration_time          = 600 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.hashclient_retry_attempts = 2 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.memcache_dead_retry      = 300 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.memcache_sasl_enabled    = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.password                 = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.proxies                  = [] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack sudo[76085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.redis_db                 = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.redis_server             = localhost:6379 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.retry_attempts           = 2 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.retry_delay              = 0.0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.socket_keepalive_count   = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack sudo[76085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.socket_keepalive_idle    = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.socket_keepalive_interval = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.socket_timeout           = 1.0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.tls_allowed_ciphers      = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.tls_cafile               = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.tls_certfile             = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.tls_enabled              = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.tls_keyfile              = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cache.username                 = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] coordination.backend_url       = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.asyncio_connection    = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.asyncio_slave_connection = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.backend               = sqlalchemy {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.connection            = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.connection_debug      = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.connection_parameters =  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.connection_recycle_time = 3600 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.connection_trace      = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.db_inc_retry_interval = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.db_max_retries        = 20 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.db_max_retry_interval = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.db_retry_interval     = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.max_overflow          = 50 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.max_pool_size         = 5 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.max_retries           = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.mysql_wsrep_sync_wait = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.pool_timeout          = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.retry_interval        = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.slave_connection      = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.sqlite_synchronous    = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.synchronous_reader    = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] database.use_db_reconnect      = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_tracing.insecure = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler.connection_string     = messaging:// {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler.enabled               = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler.es_doc_type           = notification {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler.es_scroll_size        = 10000 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler.es_scroll_time        = 2m {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler.filter_error_trace    = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler.hmac_keys             = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler.sentinel_service_name = mymaster {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler.socket_timeout        = 0.1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler.trace_requests        = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler.trace_sqlalchemy      = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler_jaeger.process_tags   = {} {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler_jaeger.service_name_prefix = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] profiler_otlp.service_name_prefix = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_policy.enforce_new_defaults = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_policy.policy_default_rule = default {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:38 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] privsep_osbrick.group          = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] privsep_osbrick.helper_command = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] privsep_osbrick.user           = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cinder_sys_admin.group         = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cinder_sys_admin.helper_command = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] cinder_sys_admin.user          = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.auth_section      = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.auth_type         = password {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.cafile            = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.certfile          = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.collect_timing    = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.insecure          = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.keyfile           = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.send_service_user_token = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.split_loggers     = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.timeout           = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.tls_ciphers       = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] service_user.tls_min_version   = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.auth_section            = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.auth_type               = password {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.certfile                = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.collect_timing          = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.insecure                = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.keyfile                 = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.region_name             = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.split_loggers           = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.timeout                 = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.tls_ciphers             = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] glance.tls_min_version         = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.backend_availability_zone = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.chap_password = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.chap_username =  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.disk_geometry = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.driver_client_cert = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.driver_client_cert_key = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.driver_data_namespace = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.driver_use_ssl = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.extra_capabilities = {} {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.filter_function = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.goodness_function = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.iscsi_target_flags =  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.iscsi_write_cache = on {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.iser_ip_address = 192.168.122.143 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.iser_port     = 3260 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.lvm_share_target = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.lvm_type      = auto {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.num_shell_tries = 3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.replication_device = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.report_discard_supported = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.reserved_percentage = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.target_helper = tgtadm {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.target_ip_address = 192.168.122.143 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.target_port   = 3260 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.target_protocol = iscsi {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.trace_flags   = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.unique_fqdn_network = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.use_chap_auth = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.volume_backend_name = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.volume_clear  = zero {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.volume_clear_ionice = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.volume_clear_size = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_reports.file_event_handler = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_reports.log_dir           = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.backend_host       = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.chap_password      = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.chap_username      = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.disk_geometry      = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.driver_client_cert = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.extra_capabilities = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.filter_function    = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.goodness_function  = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.iser_helper        = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.iser_port          = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.lvm_type           = auto {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.replication_device = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.report_discard_supported = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.reserved_percentage = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.scst_target_driver = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.storage_protocol   = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.target_ip_address  = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.target_port        = 3260 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.trace_flags        = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.volume_clear       = zero {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] lvmdriver-1.volumes_dir        = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_notifications.driver = [] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_notifications.retry = -1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] key_manager.fixed_key          = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.barbican_api_version  = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.barbican_endpoint     = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.barbican_endpoint_type = public {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.barbican_region_name  = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.cafile                = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.certfile              = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.collect_timing        = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.insecure              = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.keyfile               = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.number_of_retries     = 60 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.retry_delay           = 1 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.send_service_user_token = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.split_loggers         = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.timeout               = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.tls_ciphers           = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.tls_min_version       = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.verify_ssl            = True {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican.verify_ssl_path       = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican_service_user.auth_section = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican_service_user.auth_type = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican_service_user.cafile   = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican_service_user.certfile = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican_service_user.collect_timing = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican_service_user.insecure = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican_service_user.keyfile  = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican_service_user.split_loggers = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican_service_user.timeout  = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican_service_user.tls_ciphers = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] barbican_service_user.tls_min_version = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.approle_role_id          = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.approle_secret_id        = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.auth_method              = approle {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.auth_path                = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.kv_mountpoint            = secret {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.kv_path                  = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.kv_version               = 2 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.namespace                = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.root_token_id            = **** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.ssl_ca_crt_file          = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.timeout                  = 60.0 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.token_file               = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.token_role               = None {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.use_ssl                  = False {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 09:55:39 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] ******************************************************************************** {{(pid=75891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 02 09:55:39 devstack sudo[76085]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:39 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:39 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:39 devstack sudo[76209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:55:39 devstack sudo[76209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:39 devstack sudo[76209]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:39 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.366s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:39 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 09:55:39 devstack cinder-volume[76047]: INFO cinder.brick.local_dev.lvm [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 02 09:55:39 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:39 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:39 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:39 devstack sudo[76324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 02 09:55:39 devstack sudo[76324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:40 devstack sudo[76324]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:40 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.339s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:40 devstack cinder-volume[76047]: DEBUG cinder.brick.local_dev.lvm [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76047) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 02 09:55:40 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:40 devstack sudo[76417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:55:40 devstack sudo[76417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:40 devstack sudo[76417]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:40 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:40 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:40 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:40 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:40 devstack sudo[76626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:55:40 devstack sudo[76626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:41 devstack sudo[76626]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:41 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.411s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:41 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:41 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:41 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:41 devstack sudo[76657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 02 09:55:41 devstack sudo[76657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:41 devstack sudo[76657]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:41 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.431s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:41 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:41 devstack sudo[76741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 02 09:55:41 devstack sudo[76741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:41 devstack sudo[76741]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:41 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:41 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:41 devstack sudo[76744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 02 09:55:41 devstack sudo[76744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:42 devstack sudo[76744]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:42 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.383s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:42 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:42 devstack sudo[76803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:55:42 devstack sudo[76803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:42 devstack sudo[76803]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:42 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:42 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:42 devstack sudo[76836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:55:42 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:43 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:43 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.365s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:43 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:43 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:43 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:43 devstack sudo[76840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:55:43 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:43 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:43 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:43 devstack cinder-volume[76047]: INFO cinder.volume.drivers.lvm [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 02 09:55:43 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:43 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:43 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:43 devstack sudo[76844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:55:43 devstack sudo[76844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:43 devstack sudo[76844]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:43 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.347s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:43 devstack cinder-volume[76047]: DEBUG cinder.volume.drivers.lvm [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Updating volume stats {{(pid=76047) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 02 09:55:43 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:43 devstack sudo[76848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 02 09:55:43 devstack sudo[76848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:44 devstack sudo[76848]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:44 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:44 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:44 devstack sudo[76857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:55:44 devstack sudo[76857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:44 devstack sudo[76857]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:44 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.338s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:44 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:44 devstack sudo[76860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:55:44 devstack sudo[76860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:44 devstack sudo[76860]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:44 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.325s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:44 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:44 devstack sudo[76863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:55:44 devstack sudo[76863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:45 devstack sudo[76863]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:45 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:45 devstack cinder-volume[76047]: INFO cinder.volume.driver [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Driver hasn't implemented _init_vendor_properties()
Nov 02 09:55:45 devstack cinder-volume[76047]: DEBUG cinder.volume.driver [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76047) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 02 09:55:45 devstack cinder-volume[76047]: DEBUG oslo_db.sqlalchemy.engines [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76047) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 09:55:45 devstack cinder-volume[76047]: DEBUG dbcounter [-] [76047] Writer thread running {{(pid=76047) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 02 09:55:45 devstack cinder-volume[76047]: DEBUG cinder.db.api [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Building query based on filter {{(pid=76047) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 02 09:55:45 devstack cinder-volume[76047]: DEBUG cinder.image.image_utils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76047) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 02 09:55:45 devstack cinder-volume[76047]: INFO cinder.keymgr.migration [None req-2e4a1203-2d98-4652-a369-9bd218606c61 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 02 09:55:45 devstack cinder-volume[76047]: DEBUG cinder.volume.drivers.lvm [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Updating volume stats {{(pid=76047) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 02 09:55:45 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:45 devstack sudo[76869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 02 09:55:45 devstack sudo[76869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:45 devstack sudo[76869]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:45 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:45 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:45 devstack sudo[76872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:55:45 devstack sudo[76872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:46 devstack sudo[76872]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:46 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.338s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:46 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:46 devstack sudo[76875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:55:46 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:46 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:46 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:46 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:46 devstack sudo[76878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:55:46 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:46 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:46 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:46 devstack cinder-volume[76047]: DEBUG cinder.manager [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Notifying Schedulers of capabilities ... {{(pid=76047) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 09:55:46 devstack cinder-volume[76047]: INFO cinder.volume.manager [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Driver initialization completed successfully.
Nov 02 09:55:46 devstack cinder-volume[76047]: INFO cinder.manager [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Initiating service 2 cleanup
Nov 02 09:55:46 devstack cinder-volume[76047]: INFO cinder.manager [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Service 2 cleanup completed.
Nov 02 09:55:46 devstack cinder-volume[76047]: DEBUG cinder.service [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Creating RPC server for service cinder-volume {{(pid=76047) start /opt/stack/cinder/cinder/service.py:231}}
Nov 02 09:55:46 devstack cinder-volume[76047]: DEBUG cinder.service [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76047) start /opt/stack/cinder/cinder/service.py:237}}
Nov 02 09:55:46 devstack cinder-volume[76047]: INFO cinder.volume.manager [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 02 09:55:46 devstack cinder-volume[76047]: DEBUG cinder.volume.drivers.lvm [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Updating volume stats {{(pid=76047) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 02 09:55:46 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:46 devstack sudo[76882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 02 09:55:46 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:47 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:47 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.365s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:47 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:47 devstack sudo[76887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:55:47 devstack sudo[76887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:47 devstack sudo[76887]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:47 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:47 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:47 devstack sudo[76890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:55:47 devstack sudo[76890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:47 devstack sudo[76890]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:47 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.328s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:47 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:55:47 devstack sudo[76896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:55:47 devstack sudo[76896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:55:48 devstack sudo[76896]: pam_unix(sudo:session): session closed for user root
Nov 02 09:55:48 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.353s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:55:48 devstack cinder-volume[76047]: INFO cinder.volume.manager [None req-dfaea5bb-8656-4f93-93e9-bbd1804b7514 None None] Driver post RPC initialization completed successfully.
Nov 02 09:55:48 devstack cinder-volume[75891]: DEBUG dbcounter [-] [75891] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 09:55:58 devstack cinder-volume[76047]: DEBUG dbcounter [-] [76047] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76047) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 09:55:58 devstack cinder-volume[76047]: DEBUG dbcounter [-] [76047] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76047) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 09:56:31 devstack cinder-volume[76047]: DEBUG oslo_service.periodic_task [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running periodic task VolumeManager._thread_info {{(pid=76047) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 09:56:31 devstack cinder-volume[76047]: DEBUG cinder.volume.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] thread count: 6 {{(pid=76047) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 09:56:31 devstack cinder-volume[76047]: DEBUG cinder.volume.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] thread info: [<_MainThread(MainThread, started 132868719841408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132868605594496)>, <Thread(Thread-3 (stat_writer), started daemon 132868605547008)>, <Thread(Rabbit-heartbeat, started daemon 132868604923712)>, <Thread(Thread-5 (_runner), started daemon 132868604975488)>, <Thread(Thread-7 (_runner), started daemon 132868603043520)>] {{(pid=76047) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 09:57:31 devstack cinder-volume[76047]: DEBUG oslo_service.periodic_task [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76047) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 09:57:31 devstack cinder-volume[76047]: DEBUG cinder.volume.drivers.lvm [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Updating volume stats {{(pid=76047) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 02 09:57:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:57:31 devstack sudo[82007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 02 09:57:31 devstack sudo[82007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:57:31 devstack sudo[82007]: pam_unix(sudo:session): session closed for user root
Nov 02 09:57:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:57:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:57:31 devstack sudo[82010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:57:31 devstack sudo[82010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:57:31 devstack sudo[82010]: pam_unix(sudo:session): session closed for user root
Nov 02 09:57:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:57:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:57:31 devstack sudo[82013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:57:31 devstack sudo[82013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:57:32 devstack sudo[82013]: pam_unix(sudo:session): session closed for user root
Nov 02 09:57:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:57:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:57:32 devstack sudo[82016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:57:32 devstack sudo[82016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:57:32 devstack sudo[82016]: pam_unix(sudo:session): session closed for user root
Nov 02 09:57:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:57:32 devstack cinder-volume[76047]: DEBUG cinder.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Notifying Schedulers of capabilities ... {{(pid=76047) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 09:57:32 devstack cinder-volume[76047]: DEBUG oslo_service.periodic_task [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running periodic task VolumeManager._thread_info {{(pid=76047) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 09:57:32 devstack cinder-volume[76047]: DEBUG cinder.volume.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] thread count: 6 {{(pid=76047) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 09:57:32 devstack cinder-volume[76047]: DEBUG cinder.volume.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] thread info: [<_MainThread(MainThread, started 132868719841408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132868605594496)>, <Thread(Thread-3 (stat_writer), started daemon 132868605547008)>, <Thread(Rabbit-heartbeat, started daemon 132868604923712)>, <Thread(Thread-5 (_runner), started daemon 132868604975488)>, <Thread(Thread-7 (_runner), started daemon 132868603043520)>] {{(pid=76047) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 09:57:58 devstack cinder-volume[76047]: DEBUG dbcounter [-] [76047] Writing DB stats cinder:SELECT=1 {{(pid=76047) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 09:57:58 devstack cinder-volume[76047]: DEBUG dbcounter [-] [76047] Writing DB stats cinder:UPDATE=1 {{(pid=76047) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 09:58:31 devstack cinder-volume[76047]: DEBUG oslo_service.periodic_task [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76047) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 09:58:31 devstack cinder-volume[76047]: DEBUG cinder.volume.drivers.lvm [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Updating volume stats {{(pid=76047) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 02 09:58:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:58:31 devstack sudo[83345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 02 09:58:31 devstack sudo[83345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:58:31 devstack sudo[83345]: pam_unix(sudo:session): session closed for user root
Nov 02 09:58:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:58:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:58:31 devstack sudo[83348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:58:31 devstack sudo[83348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:58:31 devstack sudo[83348]: pam_unix(sudo:session): session closed for user root
Nov 02 09:58:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:58:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:58:31 devstack sudo[83365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:58:31 devstack sudo[83365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:58:32 devstack sudo[83365]: pam_unix(sudo:session): session closed for user root
Nov 02 09:58:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:58:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:58:32 devstack sudo[83373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:58:32 devstack sudo[83373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:58:32 devstack sudo[83373]: pam_unix(sudo:session): session closed for user root
Nov 02 09:58:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:58:32 devstack cinder-volume[76047]: DEBUG cinder.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Notifying Schedulers of capabilities ... {{(pid=76047) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 09:58:32 devstack cinder-volume[76047]: DEBUG oslo_service.periodic_task [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running periodic task VolumeManager._thread_info {{(pid=76047) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 09:58:32 devstack cinder-volume[76047]: DEBUG cinder.volume.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] thread count: 6 {{(pid=76047) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 09:58:32 devstack cinder-volume[76047]: DEBUG cinder.volume.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] thread info: [<_MainThread(MainThread, started 132868719841408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132868605594496)>, <Thread(Thread-3 (stat_writer), started daemon 132868605547008)>, <Thread(Rabbit-heartbeat, started daemon 132868604923712)>, <Thread(Thread-5 (_runner), started daemon 132868604975488)>, <Thread(Thread-7 (_runner), started daemon 132868603043520)>] {{(pid=76047) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 09:59:31 devstack cinder-volume[76047]: DEBUG oslo_service.periodic_task [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76047) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 09:59:31 devstack cinder-volume[76047]: DEBUG cinder.volume.drivers.lvm [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Updating volume stats {{(pid=76047) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 02 09:59:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:59:31 devstack sudo[84884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 02 09:59:31 devstack sudo[84884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:59:31 devstack sudo[84884]: pam_unix(sudo:session): session closed for user root
Nov 02 09:59:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.369s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:59:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:59:31 devstack sudo[84889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:59:31 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:59:31 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root
Nov 02 09:59:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.373s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:59:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:59:32 devstack sudo[84896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 09:59:32 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:59:32 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root
Nov 02 09:59:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.336s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:59:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 09:59:32 devstack sudo[84914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 09:59:32 devstack sudo[84914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 09:59:32 devstack sudo[84914]: pam_unix(sudo:session): session closed for user root
Nov 02 09:59:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 09:59:32 devstack cinder-volume[76047]: DEBUG cinder.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Notifying Schedulers of capabilities ... {{(pid=76047) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 09:59:58 devstack cinder-volume[76047]: DEBUG dbcounter [-] [76047] Writing DB stats cinder:SELECT=1 {{(pid=76047) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 09:59:58 devstack cinder-volume[76047]: DEBUG dbcounter [-] [76047] Writing DB stats cinder:UPDATE=1 {{(pid=76047) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:00:31 devstack cinder-volume[76047]: DEBUG oslo_service.periodic_task [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76047) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:00:31 devstack cinder-volume[76047]: DEBUG cinder.volume.drivers.lvm [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Updating volume stats {{(pid=76047) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 02 10:00:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:00:31 devstack sudo[85727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 02 10:00:31 devstack sudo[85727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:00:31 devstack sudo[85727]: pam_unix(sudo:session): session closed for user root
Nov 02 10:00:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:00:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:00:31 devstack sudo[85733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 10:00:31 devstack sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:00:31 devstack sudo[85733]: pam_unix(sudo:session): session closed for user root
Nov 02 10:00:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:00:31 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:00:31 devstack sudo[85736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 02 10:00:31 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:00:32 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root
Nov 02 10:00:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:00:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:00:32 devstack sudo[85739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 02 10:00:32 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:00:32 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root
Nov 02 10:00:32 devstack cinder-volume[76047]: DEBUG oslo_concurrency.processutils [None req-c568d985-071f-483c-8096-4986325c7b89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76047) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:00:32 devstack cinder-volume[76047]: DEBUG cinder.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Notifying Schedulers of capabilities ... {{(pid=76047) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:00:32 devstack cinder-volume[76047]: DEBUG oslo_service.periodic_task [None req-c568d985-071f-483c-8096-4986325c7b89 None None] Running periodic task VolumeManager._thread_info {{(pid=76047) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:00:32 devstack cinder-volume[76047]: DEBUG cinder.volume.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] thread count: 6 {{(pid=76047) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:00:32 devstack cinder-volume[76047]: DEBUG cinder.volume.manager [None req-c568d985-071f-483c-8096-4986325c7b89 None None] thread info: [<_MainThread(MainThread, started 132868719841408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132868605594496)>, <Thread(Thread-3 (stat_writer), started daemon 132868605547008)>, <Thread(Rabbit-heartbeat, started daemon 132868604923712)>, <Thread(Thread-5 (_runner), started daemon 132868604975488)>, <Thread(Thread-7 (_runner), started daemon 132868603043520)>] {{(pid=76047) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:00:46 devstack cinder-volume[75891]: INFO oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Caught SIGTERM, stopping children
Nov 02 10:00:46 devstack cinder-volume[75891]: DEBUG oslo_concurrency.lockutils [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Acquiring lock "singleton_lock" {{(pid=75891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 02 10:00:46 devstack cinder-volume[75891]: DEBUG oslo_concurrency.lockutils [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Acquired lock "singleton_lock" {{(pid=75891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 02 10:00:46 devstack cinder-volume[75891]: DEBUG oslo_concurrency.lockutils [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Releasing lock "singleton_lock" {{(pid=75891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 02 10:00:46 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Stop services. {{(pid=75891) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 02 10:00:46 devstack cinder-volume[75891]: DEBUG oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Killing children. {{(pid=75891) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 02 10:00:46 devstack cinder-volume[75891]: INFO oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Waiting on 1 children to exit
Nov 02 10:00:51 devstack cinder-volume[76047]: DEBUG oslo_concurrency.lockutils [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Acquiring lock "singleton_lock" {{(pid=76047) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 02 10:00:51 devstack cinder-volume[76047]: DEBUG oslo_concurrency.lockutils [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Acquired lock "singleton_lock" {{(pid=76047) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 02 10:00:51 devstack cinder-volume[76047]: DEBUG oslo_concurrency.lockutils [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Releasing lock "singleton_lock" {{(pid=76047) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 02 10:00:51 devstack cinder-volume[76047]: WARNING amqp [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 02 10:00:51 devstack cinder-volume[76047]: WARNING amqp [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 02 10:00:51 devstack cinder-volume[75891]: INFO oslo_service.backend._eventlet.service [None req-7ec4dd39-c468-4c6f-8a17-9967a1b412a3 None None] Child 76047 exited with status 0
Nov 02 10:00:52 devstack cinder-volume[86148]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 02 10:00:52 devstack cinder-volume[86148]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 02 10:00:52 devstack cinder-volume[86148]: we strongly recommend against using it for new projects.
Nov 02 10:00:52 devstack cinder-volume[86148]: If you are already using Eventlet, we recommend migrating to a different
Nov 02 10:00:52 devstack cinder-volume[86148]: framework.  For more detail see
Nov 02 10:00:52 devstack cinder-volume[86148]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 02 10:00:52 devstack cinder-volume[86148]:   import eventlet  # noqa
Nov 02 10:00:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 02 10:00:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 02 10:00:54 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 02 10:00:55 devstack cinder-volume[86148]: INFO dbcounter [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Registered counter for database cinder
Nov 02 10:00:55 devstack cinder-volume[86148]: DEBUG oslo_db.sqlalchemy.engines [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86148) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 10:00:55 devstack cinder-volume[86148]: DEBUG dbcounter [-] [86148] Writer thread running {{(pid=86148) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 02 10:00:55 devstack cinder-volume[86148]: INFO cinder.rpc [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 02 10:00:55 devstack cinder-volume[86148]: INFO cinder.rpc [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 02 10:00:55 devstack cinder-volume[86148]: DEBUG oslo_db.sqlalchemy.engines [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86148) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 10:00:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Determined volume DB was empty at startup.
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG cinder.volume.manager [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86148) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 02 10:00:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 02 10:00:56 devstack cinder-volume[86148]: WARNING stevedore.named [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 02 10:00:56 devstack cinder-volume[86148]: WARNING castellan.key_manager [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 02 10:00:56 devstack cinder-volume[86148]: WARNING cinder.keymgr.conf_key_mgr [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 02 10:00:56 devstack cinder-volume[86148]: INFO cinder.volume.manager [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_db.sqlalchemy.engines [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86148) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 10:00:56 devstack cinder-volume[86148]: INFO oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Starting 1 workers
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Started child 86290 {{(pid=86148) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Full set of CONF: {{(pid=86148) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] ******************************************************************************** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Configuration options gathered from: {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] ================================================================================ {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] allow_availability_zone_fallback = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] allow_compression_on_image_upload = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] allowed_direct_url_schemes     = [] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] api_rate_limit                 = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86290]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] auth_strategy                  = keystone {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_availability_zone      = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_host                   = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_name                   = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_stats_polling_interval = 60 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backup_api_class               = cinder.backup.api.API {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backup_name_template           = backup-%s {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backup_use_same_host           = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backup_use_temp_snapshot       = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] chap_password                  = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] chap_username                  =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cinder_internal_tenant_project_id = 932430305d7e4af7acefed48f1484611 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cinder_internal_tenant_user_id = 8e33838613f94e87a92bb60001e538fb {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cluster                        = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] compression_format             = gzip {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] compute_api_class              = cinder.compute.nova.API {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] config_dir                     = [] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] config_source                  = [] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] control_exchange               = openstack {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] debug                          = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] default_availability_zone      = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] default_group_type             = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] default_volume_type            = QuobyteHD {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] disk_geometry                  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] driver_client_cert             = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] driver_client_cert_key         = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] driver_data_namespace          = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] driver_ssl_cert_path           = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] driver_ssl_cert_verify         = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] driver_use_ssl                 = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] enable_new_services            = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] enable_unsupported_driver      = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] enabled_backends               = ['QuobyteHD'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] enforce_multipath_for_image_xfer = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] filter_function                = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance_api_insecure            = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance_api_servers             = ['http://192.168.122.143/image'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance_api_ssl_compression     = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance_ca_certificates_file    = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance_catalog_info            = image:glance:publicURL {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance_certfile                = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance_keyfile                 = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance_num_retries             = 3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance_request_timeout         = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] goodness_function              = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] graceful_shutdown_timeout      = 5 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] group_api_class                = cinder.group.api.API {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] host                           = devstack {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_compress_on_upload       = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_conversion_address_space_limit = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_conversion_cpu_limit     = 60 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_conversion_disable       = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_introspection_address_space_limit = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_introspection_cpu_limit  = 60 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_upload_use_cinder_backend = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_upload_use_internal_tenant = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_volume_cache_enabled     = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_volume_cache_max_count   = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] image_volume_cache_max_size_gb = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] init_host_max_objects_retrieval = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] instance_format                = [instance: %(uuid)s]  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86290]: INFO cinder.volume.manager [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] iscsi_target_flags             =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] iscsi_write_cache              = on {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] iser_helper                    = tgtadm {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] iser_ip_address                = 192.168.122.143 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86290]: DEBUG cinder.volume.drivers.remotefs [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86290) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] iser_port                      = 3260 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] log_color                      = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] log_config_append              = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] log_dir                        = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] log_file                       = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] log_options                    = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] log_rotate_interval            = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] log_rotate_interval_type       = days {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] log_rotation_type              = none {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] max_age                        = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] max_logfile_count              = 30 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] max_logfile_size_mb            = 200 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] max_over_subscription_ratio    = 20.0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] message_reap_interval          = 86400 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] message_ttl                    = 2592000 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] migration_create_volume_timeout_secs = 300 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] monkey_patch                   = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] monkey_patch_modules           = [] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] my_ip                          = 192.168.122.143 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] no_snapshot_gb_quota           = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] num_iser_scan_tries            = 3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] num_shell_tries                = 3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] num_volume_device_scan_tries   = 3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] nvmeof_conn_info_version       = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] nvmet_ns_id                    = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] nvmet_port_id                  = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] osapi_max_limit                = 1000 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] osapi_volume_ext_list          = [] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] osapi_volume_listen_port       = 8776 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] osapi_volume_use_ssl           = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] osapi_volume_workers           = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] per_volume_size_limit          = -1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] periodic_fuzzy_delay           = 60 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] periodic_interval              = 60 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] public_endpoint                = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] publish_errors                 = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] quota_backup_gigabytes         = 1000 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] quota_backups                  = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] quota_gigabytes                = 1000 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] quota_groups                   = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] quota_snapshots                = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] quota_volumes                  = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] rate_limit_burst               = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] rate_limit_except_level        = CRITICAL {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] rate_limit_interval            = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] reinit_driver_count            = 3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] replication_device             = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] report_discard_supported       = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] report_interval                = 120 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] reservation_clean_interval     = 86400 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] reservation_expire             = 86400 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] reserved_image_namespaces      = [] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] reserved_percentage            = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] rpc_response_timeout           = 120 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] run_external_periodic_tasks    = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] scst_target_driver             = iscsi {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] scst_target_iqn_name           = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_down_time              = 720 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] shell_completion               = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] snapshot_name_template         = snapshot-%s {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] split_loggers                  = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] state_path                     = /opt/stack/data/cinder {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] storage_availability_zone      = nova {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] storage_protocol               = iSCSI {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] syslog_log_facility            = LOG_USER {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] target_helper                  = lioadm {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] target_ip_address              = 192.168.122.143 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] target_port                    = 3260 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] target_protocol                = iscsi {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] target_secondary_ip_addresses  = [] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] trace_flags                    = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] transport_url                  = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] until_refresh                  = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] use_chap_auth                  = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] use_default_quota_class        = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] use_journal                    = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] use_json                       = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] use_multipath_for_image_xfer   = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] use_stderr                     = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] use_syslog                     = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] verify_glance_signatures       = enabled {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_api_class               = cinder.volume.api.API {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_backend_name            = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_clear                   = zero {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_clear_ionice            = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_clear_size              = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_copy_bps_limit          = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_dd_blocksize            = 1M {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_name_template           = volume-%s {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_service_inithost_offload = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volume_usage_audit_period      = month {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] zoning_mode                    = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_concurrency.disable_process_locking = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.auth_section = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.auth_type   = password {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.auth_version = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.cache       = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.certfile    = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.delay_auth_decision = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.http_connect_timeout = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.include_service_catalog = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.insecure    = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.interface   = public {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.keyfile     = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86290]: DEBUG cinder.volume.drivers.quobyte [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86290) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_password = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86290]: WARNING cinder.volume.drivers.quobyte [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 02 10:00:56 devstack cinder-volume[86290]: WARNING cinder.volume.drivers.quobyte [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Running cmd (subprocess): mount.quobyte {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcache_username = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.region_name = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.service_token_roles_required = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.service_type = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.token_cache_time = 300 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.143/identity {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.backend                  = dogpile.cache.null {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.backend_argument         = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.backend_expiration_time  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.config_prefix            = cache.oslo {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.debug_cache_backend      = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.enable_retry_client      = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.enable_socket_keepalive  = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.enabled                  = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.expiration_time          = 600 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.hashclient_retry_attempts = 2 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.memcache_dead_retry      = 300 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.memcache_pool_maxsize    = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.memcache_sasl_enabled    = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.password                 = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.proxies                  = [] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.redis_db                 = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.redis_sentinel_service_name = mymaster {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.redis_server             = localhost:6379 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.retry_attempts           = 2 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.retry_delay              = 0.0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.socket_keepalive_count   = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.socket_keepalive_idle    = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.socket_keepalive_interval = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.socket_timeout           = 1.0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.tls_allowed_ciphers      = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.tls_cafile               = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.tls_certfile             = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.tls_enabled              = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.tls_keyfile              = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cache.username                 = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] coordination.backend_url       = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.asyncio_connection    = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.asyncio_slave_connection = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.backend               = sqlalchemy {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.connection            = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.connection_debug      = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.connection_parameters =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.connection_recycle_time = 3600 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.connection_trace      = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.db_inc_retry_interval = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.db_max_retries        = 20 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.db_max_retry_interval = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.db_retry_interval     = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.max_overflow          = 50 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.max_pool_size         = 5 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.max_retries           = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.mysql_wsrep_sync_wait = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.pool_timeout          = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.retry_interval        = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.slave_connection      = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.sqlite_synchronous    = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.synchronous_reader    = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] database.use_db_reconnect      = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_tracing.insecure = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler.connection_string     = messaging:// {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler.enabled               = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler.es_doc_type           = notification {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler.es_scroll_size        = 10000 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler.es_scroll_time        = 2m {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler.filter_error_trace    = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler.hmac_keys             = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler.sentinel_service_name = mymaster {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler.socket_timeout        = 0.1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler.trace_requests        = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler.trace_sqlalchemy      = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler_jaeger.process_tags   = {} {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler_jaeger.service_name_prefix = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] profiler_otlp.service_name_prefix = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_policy.enforce_new_defaults = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_policy.policy_default_rule = default {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_policy.policy_file        = policy.yaml {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] privsep_osbrick.group          = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] privsep_osbrick.helper_command = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] privsep_osbrick.user           = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cinder_sys_admin.group         = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cinder_sys_admin.helper_command = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] cinder_sys_admin.user          = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.auth_section      = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.auth_type         = password {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.cafile            = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.certfile          = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.collect_timing    = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.insecure          = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.keyfile           = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.send_service_user_token = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.split_loggers     = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.timeout           = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.tls_ciphers       = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] service_user.tls_min_version   = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.auth_section            = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.auth_type               = password {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.certfile                = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.collect_timing          = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.insecure                = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.keyfile                 = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.region_name             = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.split_loggers           = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.timeout                 = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.tls_ciphers             = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] glance.tls_min_version         = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.backend_availability_zone = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.chap_password = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.chap_username =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.disk_geometry = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack quobyte-client[86291]: Reading configuration file: /etc/quobyte/client.cfg
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.driver_client_cert = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.driver_client_cert_key = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.driver_data_namespace = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.driver_use_ssl = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack quobyte-client[86291]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.enable_unsupported_driver = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.extra_capabilities = {} {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.filter_function = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.goodness_function = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.iscsi_target_flags =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] CMD "mount.quobyte" returned: 1 in 0.142s {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:00:56 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.iscsi_write_cache = on {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.iser_helper   = tgtadm {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86290]: DEBUG cinder.volume.drivers.quobyte [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=86290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.iser_ip_address = 192.168.122.143 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.iser_port     = 3260 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86290]: INFO cinder.volume.drivers.quobyte [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 ...
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nas_host      =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nas_login     = admin {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nas_mount_options = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nas_password  = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nas_private_key =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a -c /etc/quobyte/client-cinder.cfg {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nas_share_path =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.num_shell_tries = 3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.nvmet_port_id = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.quobyte_client_cfg = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.quobyte_volume_url = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.replication_device = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.report_discard_supported = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.reserved_percentage = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.scst_target_driver = iscsi {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.scst_target_iqn_name = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.storage_protocol = iSCSI {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.target_helper = tgtadm {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.target_ip_address = 192.168.122.143 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.target_port   = 3260 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.target_protocol = iscsi {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.trace_flags   = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.unique_fqdn_network = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.use_chap_auth = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.volume_backend_name = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.volume_clear  = zero {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.volume_clear_ionice = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.volume_clear_size = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_reports.file_event_handler = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_reports.log_dir           = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.backend_availability_zone = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.backend_host         = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.chap_password        = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.chap_username        = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.chiscsi_conf         = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.disk_geometry        = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.driver_client_cert   = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.driver_client_cert_key = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.driver_data_namespace = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack sudo[86292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a -c /etc/quobyte/client-cinder.cfg
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.driver_use_ssl       = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.extra_capabilities   = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.filter_function      = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.goodness_function    = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.iser_helper          = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.iser_ip_address      = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.iser_port            = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.iser_target_prefix   = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nas_host             = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nas_login            = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nas_mount_options    = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nas_password         = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nas_private_key      = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nas_share_path       = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nas_ssh_port         = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.num_shell_tries      = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.nvmet_port_id        = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.replication_device   = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.report_discard_supported = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.reserved_percentage  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.scst_target_driver   = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.storage_protocol     = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.target_helper        = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.target_ip_address    = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.target_port          = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.target_prefix        = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.target_protocol      = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.trace_flags          = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.use_chap_auth        = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.volume_clear         = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.volume_clear_size    = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] QuobyteHD.volumes_dir          = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.ssl      = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_notifications.driver = [] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_notifications.retry = -1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] oslo_messaging_notifications.transport_url = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] key_manager.fixed_key          = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.barbican_api_version  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.barbican_endpoint     = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.barbican_endpoint_type = public {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.barbican_region_name  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.cafile                = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.certfile              = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.collect_timing        = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.insecure              = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.keyfile               = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.number_of_retries     = 60 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.retry_delay           = 1 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.send_service_user_token = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.split_loggers         = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.timeout               = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.tls_ciphers           = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.tls_min_version       = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.verify_ssl            = True {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican.verify_ssl_path       = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican_service_user.auth_section = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican_service_user.auth_type = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican_service_user.cafile   = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican_service_user.certfile = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican_service_user.collect_timing = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican_service_user.insecure = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican_service_user.keyfile  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican_service_user.split_loggers = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican_service_user.timeout  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican_service_user.tls_ciphers = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] barbican_service_user.tls_min_version = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.approle_role_id          = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.approle_secret_id        = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.auth_method              = approle {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.auth_path                = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.kv_mountpoint            = secret {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.kv_path                  = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.kv_version               = 2 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.namespace                = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.root_token_id            = **** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.ssl_ca_crt_file          = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.timeout                  = 60.0 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.token_file               = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.token_role               = None {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.use_ssl                  = False {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:00:56 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] ******************************************************************************** {{(pid=86148) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 02 10:00:57 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.852s {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:00:57 devstack cinder-volume[86290]: INFO cinder.volume.drivers.quobyte [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 succeeded
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG cinder.volume.drivers.quobyte [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=86290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.869s {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:00:57 devstack sudo[86478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:00:57 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:00:57 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.247s {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:00:57 devstack cinder-volume[86290]: INFO cinder.volume.driver [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Driver hasn't implemented _init_vendor_properties()
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG cinder.volume.driver [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.772819519043, 'free_capacity_gb': 1773.772819519043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86290) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG oslo_db.sqlalchemy.engines [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG dbcounter [-] [86290] Writer thread running {{(pid=86290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG cinder.db.api [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Building query based on filter {{(pid=86290) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG cinder.image.image_utils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86290) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 02 10:00:57 devstack cinder-volume[86290]: INFO cinder.keymgr.migration [None req-649e40ed-fa9c-41f7-ab0f-49226d20e6ea None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG cinder.volume.drivers.quobyte [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=86290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG cinder.volume.drivers.quobyte [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=86290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:00:57 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:00:57 devstack sudo[86481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:00:57 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:00:58 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root
Nov 02 10:00:58 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.296s {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:00:58 devstack cinder-volume[86290]: DEBUG cinder.manager [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Notifying Schedulers of capabilities ... {{(pid=86290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:00:58 devstack cinder-volume[86290]: INFO cinder.volume.manager [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Driver initialization completed successfully.
Nov 02 10:00:58 devstack cinder-volume[86290]: INFO cinder.manager [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Initiating service 3 cleanup
Nov 02 10:00:58 devstack cinder-volume[86290]: INFO cinder.manager [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Service 3 cleanup completed.
Nov 02 10:00:58 devstack cinder-volume[86290]: DEBUG cinder.service [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Creating RPC server for service cinder-volume {{(pid=86290) start /opt/stack/cinder/cinder/service.py:231}}
Nov 02 10:00:58 devstack cinder-volume[86290]: DEBUG cinder.service [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86290) start /opt/stack/cinder/cinder/service.py:237}}
Nov 02 10:00:58 devstack cinder-volume[86290]: INFO cinder.volume.manager [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 02 10:00:58 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:00:58 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:00:58 devstack cinder-volume[86290]: DEBUG cinder.volume.drivers.quobyte [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=86290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:00:58 devstack cinder-volume[86290]: DEBUG cinder.volume.drivers.quobyte [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=86290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:00:58 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:00:58 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:00:58 devstack sudo[86518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:00:58 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:00:58 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root
Nov 02 10:00:58 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.473s {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:00:58 devstack cinder-volume[86290]: INFO cinder.volume.manager [None req-12c34a23-1cc5-4d3a-9721-2510d196a8ba None None] Driver post RPC initialization completed successfully.
Nov 02 10:01:03 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-2f923e68-b38f-44b0-a473-bf2382559b02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:01:03 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-2f923e68-b38f-44b0-a473-bf2382559b02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:01:03 devstack cinder-volume[86290]: DEBUG cinder.volume.drivers.quobyte [None req-2f923e68-b38f-44b0-a473-bf2382559b02 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=86290) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:01:03 devstack cinder-volume[86290]: DEBUG cinder.volume.drivers.quobyte [None req-2f923e68-b38f-44b0-a473-bf2382559b02 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=86290) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:01:03 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-2f923e68-b38f-44b0-a473-bf2382559b02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86290) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:01:03 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-2f923e68-b38f-44b0-a473-bf2382559b02 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:01:03 devstack sudo[86642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:01:03 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:01:03 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root
Nov 02 10:01:03 devstack cinder-volume[86290]: DEBUG oslo_concurrency.processutils [None req-2f923e68-b38f-44b0-a473-bf2382559b02 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.341s {{(pid=86290) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:01:03 devstack cinder-volume[86290]: DEBUG cinder.manager [None req-2f923e68-b38f-44b0-a473-bf2382559b02 None None] Notifying Schedulers of capabilities ... {{(pid=86290) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:01:05 devstack cinder-volume[86148]: INFO oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Caught SIGTERM, stopping children
Nov 02 10:01:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Acquiring lock "singleton_lock" {{(pid=86148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 02 10:01:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Acquired lock "singleton_lock" {{(pid=86148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 02 10:01:05 devstack cinder-volume[86148]: DEBUG oslo_concurrency.lockutils [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Releasing lock "singleton_lock" {{(pid=86148) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 02 10:01:05 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Stop services. {{(pid=86148) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 02 10:01:05 devstack cinder-volume[86148]: DEBUG oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Killing children. {{(pid=86148) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 02 10:01:05 devstack cinder-volume[86148]: INFO oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Waiting on 1 children to exit
Nov 02 10:01:06 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Acquiring lock "singleton_lock" {{(pid=86290) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 02 10:01:06 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Acquired lock "singleton_lock" {{(pid=86290) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 02 10:01:06 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Releasing lock "singleton_lock" {{(pid=86290) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 02 10:01:06 devstack cinder-volume[86290]: WARNING amqp [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 02 10:01:06 devstack cinder-volume[86290]: WARNING amqp [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 02 10:01:06 devstack cinder-volume[86148]: INFO oslo_service.backend._eventlet.service [None req-e3fa8a7e-986b-4782-b4fb-ab6195cdf4df None None] Child 86290 exited with status 0
Nov 02 10:01:07 devstack cinder-volume[86721]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 02 10:01:07 devstack cinder-volume[86721]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 02 10:01:07 devstack cinder-volume[86721]: we strongly recommend against using it for new projects.
Nov 02 10:01:07 devstack cinder-volume[86721]: If you are already using Eventlet, we recommend migrating to a different
Nov 02 10:01:07 devstack cinder-volume[86721]: framework.  For more detail see
Nov 02 10:01:07 devstack cinder-volume[86721]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 02 10:01:07 devstack cinder-volume[86721]:   import eventlet  # noqa
Nov 02 10:01:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 02 10:01:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 02 10:01:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 02 10:01:12 devstack cinder-volume[86721]: INFO dbcounter [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Registered counter for database cinder
Nov 02 10:01:12 devstack cinder-volume[86721]: DEBUG oslo_db.sqlalchemy.engines [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86721) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 10:01:12 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writer thread running {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 02 10:01:12 devstack cinder-volume[86721]: INFO cinder.rpc [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 02 10:01:12 devstack cinder-volume[86721]: INFO cinder.rpc [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_db.sqlalchemy.engines [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86721) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 10:01:13 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Determined volume DB was empty at startup.
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86721) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 02 10:01:13 devstack cinder-volume[86721]: WARNING stevedore.named [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 02 10:01:13 devstack cinder-volume[86721]: WARNING castellan.key_manager [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 02 10:01:13 devstack cinder-volume[86721]: WARNING cinder.keymgr.conf_key_mgr [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 02 10:01:13 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_db.sqlalchemy.engines [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86721) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 10:01:13 devstack cinder-volume[86721]: INFO oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Starting 1 workers
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Started child 87014 {{(pid=86721) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Full set of CONF: {{(pid=86721) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] ******************************************************************************** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] Configuration options gathered from: {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 02 10:01:13 devstack cinder-volume[87014]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] ================================================================================ {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] allow_availability_zone_fallback = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] allow_compression_on_image_upload = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] allowed_direct_url_schemes     = [] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] api_rate_limit                 = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] auth_strategy                  = keystone {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_availability_zone      = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_host                   = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_name                   = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_stats_polling_interval = 60 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backup_api_class               = cinder.backup.api.API {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backup_name_template           = backup-%s {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backup_use_same_host           = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backup_use_temp_snapshot       = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] chap_password                  = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] chap_username                  =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cinder_internal_tenant_project_id = 932430305d7e4af7acefed48f1484611 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cinder_internal_tenant_user_id = 8e33838613f94e87a92bb60001e538fb {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cluster                        = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] compression_format             = gzip {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] config_dir                     = [] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] config_source                  = [] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] control_exchange               = openstack {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] debug                          = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] default_availability_zone      = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] default_group_type             = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] default_volume_type            = QuobyteHD {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] disk_geometry                  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] driver_client_cert             = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] driver_client_cert_key         = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] driver_data_namespace          = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] driver_ssl_cert_path           = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] driver_ssl_cert_verify         = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] driver_use_ssl                 = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] enable_new_services            = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] enable_unsupported_driver      = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 02 10:01:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87014) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] enforce_multipath_for_image_xfer = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] filter_function                = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance_api_insecure            = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance_api_servers             = ['http://192.168.122.143/image'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance_api_ssl_compression     = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance_ca_certificates_file    = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance_certfile                = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance_keyfile                 = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance_num_retries             = 3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance_request_timeout         = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] goodness_function              = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] graceful_shutdown_timeout      = 5 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] group_api_class                = cinder.group.api.API {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] host                           = devstack {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_compress_on_upload       = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_conversion_address_space_limit = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_conversion_cpu_limit     = 60 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_conversion_disable       = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_introspection_address_space_limit = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_introspection_cpu_limit  = 60 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_upload_use_cinder_backend = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_upload_use_internal_tenant = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_volume_cache_enabled     = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_volume_cache_max_count   = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] image_volume_cache_max_size_gb = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] init_host_max_objects_retrieval = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87014) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 02 10:01:13 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.quobyte [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 02 10:01:13 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.quobyte [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 02 10:01:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Running cmd (subprocess): mount.quobyte {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] iscsi_target_flags             =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] iscsi_write_cache              = on {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] iser_helper                    = tgtadm {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] iser_ip_address                = 192.168.122.143 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] iser_port                      = 3260 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] log_color                      = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] log_config_append              = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] log_dir                        = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] log_file                       = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] log_options                    = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] log_rotate_interval            = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] log_rotate_interval_type       = days {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] log_rotation_type              = none {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] max_age                        = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] max_logfile_count              = 30 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] max_logfile_size_mb            = 200 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] max_over_subscription_ratio    = 20.0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] message_reap_interval          = 86400 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] message_ttl                    = 2592000 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] migration_create_volume_timeout_secs = 300 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] monkey_patch                   = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] monkey_patch_modules           = [] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] my_ip                          = 192.168.122.143 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] no_snapshot_gb_quota           = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] num_iser_scan_tries            = 3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] num_shell_tries                = 3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] num_volume_device_scan_tries   = 3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] nvmeof_conn_info_version       = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] nvmet_ns_id                    = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] nvmet_port_id                  = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] osapi_max_limit                = 1000 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] osapi_volume_ext_list          = [] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] osapi_volume_listen_port       = 8776 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] osapi_volume_use_ssl           = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] osapi_volume_workers           = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] per_volume_size_limit          = -1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] periodic_fuzzy_delay           = 60 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] periodic_interval              = 60 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] public_endpoint                = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] publish_errors                 = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] quota_backup_gigabytes         = 1000 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] quota_backups                  = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] quota_gigabytes                = 1000 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] quota_groups                   = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] quota_snapshots                = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] quota_volumes                  = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] rate_limit_burst               = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] rate_limit_except_level        = CRITICAL {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] rate_limit_interval            = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] reinit_driver_count            = 3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] replication_device             = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] report_discard_supported       = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] report_interval                = 120 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] reservation_clean_interval     = 86400 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] reservation_expire             = 86400 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] reserved_image_namespaces      = [] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] reserved_percentage            = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] rpc_response_timeout           = 120 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] run_external_periodic_tasks    = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] scst_target_driver             = iscsi {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] scst_target_iqn_name           = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_down_time              = 720 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] shell_completion               = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] snapshot_name_template         = snapshot-%s {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] split_loggers                  = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] state_path                     = /opt/stack/data/cinder {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] storage_availability_zone      = nova {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] storage_protocol               = iSCSI {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] syslog_log_facility            = LOG_USER {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] target_helper                  = lioadm {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] target_ip_address              = 192.168.122.143 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] target_port                    = 3260 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] target_protocol                = iscsi {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] target_secondary_ip_addresses  = [] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] trace_flags                    = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] transport_url                  = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] until_refresh                  = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] use_chap_auth                  = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] use_default_quota_class        = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] use_journal                    = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] use_json                       = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] use_multipath_for_image_xfer   = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] use_stderr                     = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] use_syslog                     = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] verify_glance_signatures       = enabled {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_api_class               = cinder.volume.api.API {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_backend_name            = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_clear                   = zero {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_clear_ionice            = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_clear_size              = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] CMD "mount.quobyte" returned: 1 in 0.107s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_copy_bps_limit          = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_dd_blocksize            = 1M {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_name_template           = volume-%s {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_service_inithost_offload = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volume_usage_audit_period      = month {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] zoning_mode                    = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_concurrency.disable_process_locking = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.auth_section = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.auth_type   = password {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.auth_version = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.cache       = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.certfile    = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:01:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.include_service_catalog = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.insecure    = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.interface   = public {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.keyfile     = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_password = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcache_username = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.region_name = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.service_type = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.143/identity {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.backend                  = dogpile.cache.null {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.backend_argument         = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.backend_expiration_time  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.config_prefix            = cache.oslo {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.debug_cache_backend      = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.enable_retry_client      = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.enable_socket_keepalive  = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.enabled                  = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.expiration_time          = 600 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.hashclient_retry_attempts = 2 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.memcache_dead_retry      = 300 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.memcache_sasl_enabled    = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack sudo[87019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.password                 = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.proxies                  = [] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.redis_db                 = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.redis_server             = localhost:6379 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.retry_attempts           = 2 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.retry_delay              = 0.0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.socket_keepalive_count   = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.socket_keepalive_idle    = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.socket_keepalive_interval = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.socket_timeout           = 1.0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.tls_allowed_ciphers      = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.tls_cafile               = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.tls_certfile             = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.tls_enabled              = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.tls_keyfile              = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cache.username                 = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] coordination.backend_url       = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.asyncio_connection    = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.asyncio_slave_connection = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.backend               = sqlalchemy {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.connection            = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.connection_debug      = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.connection_parameters =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.connection_recycle_time = 3600 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.connection_trace      = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.db_inc_retry_interval = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.db_max_retries        = 20 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.db_max_retry_interval = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.db_retry_interval     = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.max_overflow          = 50 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.max_pool_size         = 5 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.max_retries           = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.mysql_wsrep_sync_wait = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.pool_timeout          = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.retry_interval        = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.slave_connection      = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.sqlite_synchronous    = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.synchronous_reader    = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] database.use_db_reconnect      = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_tracing.insecure = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler.connection_string     = messaging:// {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler.enabled               = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler.es_doc_type           = notification {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler.es_scroll_size        = 10000 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler.es_scroll_time        = 2m {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler.filter_error_trace    = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler.hmac_keys             = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler.sentinel_service_name = mymaster {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler.socket_timeout        = 0.1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler.trace_requests        = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler.trace_sqlalchemy      = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler_jaeger.process_tags   = {} {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler_jaeger.service_name_prefix = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] profiler_otlp.service_name_prefix = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_policy.enforce_new_defaults = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_policy.policy_default_rule = default {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] privsep_osbrick.group          = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] privsep_osbrick.helper_command = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] privsep_osbrick.user           = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cinder_sys_admin.group         = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cinder_sys_admin.helper_command = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] cinder_sys_admin.user          = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.auth_section      = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.auth_type         = password {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.cafile            = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.certfile          = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.collect_timing    = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.insecure          = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.keyfile           = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.send_service_user_token = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.split_loggers     = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.timeout           = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.tls_ciphers       = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] service_user.tls_min_version   = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.auth_section            = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.auth_type               = password {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.certfile                = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.collect_timing          = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.insecure                = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.keyfile                 = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.region_name             = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.split_loggers           = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.timeout                 = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.tls_ciphers             = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] glance.tls_min_version         = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.backend_availability_zone = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.chap_password = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.chap_username =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.disk_geometry = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.driver_client_cert = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.driver_client_cert_key = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.driver_data_namespace = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.driver_use_ssl = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.extra_capabilities = {} {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.filter_function = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.goodness_function = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.iscsi_target_flags =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.iscsi_write_cache = on {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.iser_ip_address = 192.168.122.143 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.iser_port     = 3260 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nas_host      =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nas_login     = admin {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nas_mount_options = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nas_password  = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nas_private_key =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nas_share_path =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.num_shell_tries = 3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.quobyte_volume_url = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.replication_device = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:13 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.report_discard_supported = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.reserved_percentage = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.target_helper = tgtadm {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.target_ip_address = 192.168.122.143 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.target_port   = 3260 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.target_protocol = iscsi {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.trace_flags   = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.unique_fqdn_network = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.use_chap_auth = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.volume_backend_name = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.volume_clear  = zero {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.volume_clear_ionice = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.volume_clear_size = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_reports.file_event_handler = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_reports.log_dir           = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.backend_availability_zone = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.backend_host         = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.chap_password        = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.chap_username        = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.disk_geometry        = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.driver_client_cert   = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.driver_data_namespace = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.extra_capabilities   = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.filter_function      = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.goodness_function    = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.iser_helper          = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.iser_ip_address      = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.iser_port            = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nas_host             = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nas_login            = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nas_mount_options    = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nas_password         = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nas_private_key      = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nas_share_path       = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.num_shell_tries      = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.replication_device   = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.report_discard_supported = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.reserved_percentage  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.scst_target_driver   = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.storage_protocol     = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.target_helper        = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.target_ip_address    = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.target_port          = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.target_prefix        = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.target_protocol      = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.trace_flags          = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.use_chap_auth        = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.volume_clear         = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.volume_clear_size    = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] QuobyteHD.volumes_dir          = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_notifications.driver = [] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_notifications.retry = -1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] key_manager.fixed_key          = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.barbican_api_version  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.barbican_endpoint     = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.barbican_endpoint_type = public {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.barbican_region_name  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.cafile                = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.certfile              = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.collect_timing        = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.insecure              = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.keyfile               = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.number_of_retries     = 60 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.retry_delay           = 1 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.send_service_user_token = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.split_loggers         = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.timeout               = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.tls_ciphers           = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.tls_min_version       = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.verify_ssl            = True {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican.verify_ssl_path       = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican_service_user.auth_section = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican_service_user.auth_type = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican_service_user.cafile   = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican_service_user.certfile = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican_service_user.collect_timing = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican_service_user.insecure = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican_service_user.keyfile  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican_service_user.split_loggers = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican_service_user.timeout  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican_service_user.tls_ciphers = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] barbican_service_user.tls_min_version = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.approle_role_id          = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.approle_secret_id        = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.auth_method              = approle {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.auth_path                = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.kv_mountpoint            = secret {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.kv_path                  = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.kv_version               = 2 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.namespace                = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.root_token_id            = **** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.ssl_ca_crt_file          = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.timeout                  = 60.0 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.token_file               = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.token_role               = None {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.use_ssl                  = False {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 02 10:01:14 devstack cinder-volume[86721]: DEBUG oslo_service.backend._eventlet.service [None req-f6563ac2-c6a8-45ae-9306-1d43d98f5dd0 None None] ******************************************************************************** {{(pid=86721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 02 10:01:14 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.490s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:01:14 devstack cinder-volume[87014]: INFO cinder.volume.driver [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Driver hasn't implemented _init_vendor_properties()
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG cinder.volume.driver [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8322715759277, 'free_capacity_gb': 1773.8322715759277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87014) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG oslo_db.sqlalchemy.engines [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87014) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writer thread running {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG cinder.db.api [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Building query based on filter {{(pid=87014) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87014) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:01:14 devstack cinder-volume[87014]: INFO cinder.keymgr.migration [None req-45c3bfed-9df3-495e-bd42-063330ea06ee None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 02 10:01:14 devstack sudo[87023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:01:14 devstack sudo[87023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:01:14 devstack sudo[87023]: pam_unix(sudo:session): session closed for user root
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.283s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:01:14 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Driver initialization completed successfully.
Nov 02 10:01:14 devstack cinder-volume[87014]: INFO cinder.manager [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Initiating service 3 cleanup
Nov 02 10:01:14 devstack cinder-volume[87014]: INFO cinder.manager [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Service 3 cleanup completed.
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG cinder.service [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Creating RPC server for service cinder-volume {{(pid=87014) start /opt/stack/cinder/cinder/service.py:231}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG cinder.service [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87014) start /opt/stack/cinder/cinder/service.py:237}}
Nov 02 10:01:14 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:01:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:01:14 devstack sudo[87034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:01:14 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:01:15 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root
Nov 02 10:01:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.268s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:01:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6b10ccf5-f2c4-4e01-8fe0-c06ac7672a54 None None] Driver post RPC initialization completed successfully.
Nov 02 10:01:23 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:01:24 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=3 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:01:25 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:02:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:02:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 6 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:02:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:02:42 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:02:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Flow 'volume_create_manager' (f1594a62-c46d-4e2c-a06d-32ce579f6c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:02:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7af4b53-b54b-4650-a039-17b8e33758a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7af4b53-b54b-4650-a039-17b8e33758a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1573662483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44f8766-2511-43bd-8880-1a39698619da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389b0e7fd264b3c9be5f62a32cc0c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:43Z,use_quota=True,user_id='8beee2544fb44eb8bd92a9f8d2fa02f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda9eb82-b2cb-439c-9bbf-f15c7e58fee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda9eb82-b2cb-439c-9bbf-f15c7e58fee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639d2420-1a21-484d-9010-46f7711e0e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639d2420-1a21-484d-9010-46f7711e0e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd44f8766-2511-43bd-8880-1a39698619da', 'volume_name': 'volume-d44f8766-2511-43bd-8880-1a39698619da', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7968f87-974d-4b93-b2d4-3c2ee0646255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7968f87-974d-4b93-b2d4-3c2ee0646255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e2a959-66cb-4e5a-ba35-0d0ee8d11a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:02:43 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Volume d44f8766-2511-43bd-8880-1a39698619da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d44f8766-2511-43bd-8880-1a39698619da', 'volume_size': 1}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1573662483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44f8766-2511-43bd-8880-1a39698619da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b389b0e7fd264b3c9be5f62a32cc0c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:02:43Z,use_quota=True,user_id='8beee2544fb44eb8bd92a9f8d2fa02f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Creating volume d44f8766-2511-43bd-8880-1a39698619da {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:02:43 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:02:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:02:43 devstack sudo[87705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da 1073741824
Nov 02 10:02:43 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:02:45 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root
Nov 02 10:02:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da 1073741824" returned: 0 in 1.966s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:02:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:02:45 devstack sudo[88037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da
Nov 02 10:02:45 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:02:46 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root
Nov 02 10:02:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da" returned: 0 in 0.848s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:02:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] <== create_volume: return (3135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:02:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.150s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:02:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e2a959-66cb-4e5a-ba35-0d0ee8d11a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d44f8766-2511-43bd-8880-1a39698619da', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:02:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e9686f-eebf-45ae-9bee-0416cc0e645b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:02:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Volume volume-d44f8766-2511-43bd-8880-1a39698619da (d44f8766-2511-43bd-8880-1a39698619da): created successfully
Nov 02 10:02:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e9686f-eebf-45ae-9bee-0416cc0e645b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:02:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Flow 'volume_create_manager' (f1594a62-c46d-4e2c-a06d-32ce579f6c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:02:46 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-539945e6-48dc-44dc-a4e2-fec89a0a8bda tempest-DeleteServersTestJSON-1801799298 None] Created volume successfully.
Nov 02 10:02:52 devstack cinder-volume[87014]: WARNING py.warnings [req-ecffd0bb-407b-4db0-86ed-cf8ec6b2784d req-8e473475-7fee-4b03-99ae-8a5607ba32f3 tempest-DeleteServersTestJSON-1801799298 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Nov 02 10:02:52 devstack cinder-volume[87014]:   .first()
Nov 02 10:02:52 devstack cinder-volume[87014]: 
Nov 02 10:02:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ecffd0bb-407b-4db0-86ed-cf8ec6b2784d req-8e473475-7fee-4b03-99ae-8a5607ba32f3 tempest-DeleteServersTestJSON-1801799298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:02:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ecffd0bb-407b-4db0-86ed-cf8ec6b2784d req-8e473475-7fee-4b03-99ae-8a5607ba32f3 tempest-DeleteServersTestJSON-1801799298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:02:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ecffd0bb-407b-4db0-86ed-cf8ec6b2784d req-8e473475-7fee-4b03-99ae-8a5607ba32f3 tempest-DeleteServersTestJSON-1801799298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:02:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-ecffd0bb-407b-4db0-86ed-cf8ec6b2784d req-8e473475-7fee-4b03-99ae-8a5607ba32f3 tempest-DeleteServersTestJSON-1801799298 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-d44f8766-2511-43bd-8880-1a39698619da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6e41c84-3522-448a-a74d-1e47696f6150', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:02:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-ecffd0bb-407b-4db0-86ed-cf8ec6b2784d req-8e473475-7fee-4b03-99ae-8a5607ba32f3 tempest-DeleteServersTestJSON-1801799298 None] attachment_update completed successfully.
Nov 02 10:03:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-02b919ce-c430-4614-bb23-c501ec749783 req-eea07c1f-82f3-44ab-bbeb-c0b84168574e tempest-DeleteServersTestJSON-1801799298 None] Terminate volume connection completed successfully.
Nov 02 10:03:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-02b919ce-c430-4614-bb23-c501ec749783 req-eea07c1f-82f3-44ab-bbeb-c0b84168574e tempest-DeleteServersTestJSON-1801799298 None] Deleting attachment b6e41c84-3522-448a-a74d-1e47696f6150. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Flow 'volume_create_manager' (5ecfedc5-0fd8-41db-8cab-35d411dfd674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faafc85-2ec8-4665-a80e-491e26c9699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faafc85-2ec8-4665-a80e-491e26c9699a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1174812417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b074281a98e84928888fe34f1e0aafab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:03Z,use_quota=True,user_id='76dc68cff7fd451e9371c95ce55eb9e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefa67b1-5ecd-485b-b7de-b8bae978c709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefa67b1-5ecd-485b-b7de-b8bae978c709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f151cf3-a828-4255-9c14-13e1b831c554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f151cf3-a828-4255-9c14-13e1b831c554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b', 'volume_name': 'volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fdd9cc-009d-4b24-8628-43a2243f7ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fdd9cc-009d-4b24-8628-43a2243f7ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7b464c-f6a5-4b66-88e3-cddc70e14cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:02 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Volume da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b', 'volume_size': 1}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1174812417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b074281a98e84928888fe34f1e0aafab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:03Z,use_quota=True,user_id='76dc68cff7fd451e9371c95ce55eb9e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Creating volume da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:03:02 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:03:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:03:02 devstack sudo[88724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b 1073741824
Nov 02 10:03:02 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:03 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b 1073741824" returned: 0 in 0.541s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:03:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:03:03 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b
Nov 02 10:03:03 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:03 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b" returned: 0 in 0.306s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:03:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:03:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:03:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7b464c-f6a5-4b66-88e3-cddc70e14cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84197847-e034-469d-a339-62ae6378e2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:03 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Volume volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b (da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b): created successfully
Nov 02 10:03:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84197847-e034-469d-a339-62ae6378e2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Flow 'volume_create_manager' (5ecfedc5-0fd8-41db-8cab-35d411dfd674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:03:03 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-288cf0dc-d445-4088-9dd8-0262217fcd97 tempest-VolumesAdminNegativeTest-1162468077 None] Created volume successfully.
Nov 02 10:03:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Acquiring lock "cinder-d44f8766-2511-43bd-8880-1a39698619da-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:03:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Lock "cinder-d44f8766-2511-43bd-8880-1a39698619da-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:03:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Acquiring lock "cinder-quobyte-d44f8766-2511-43bd-8880-1a39698619da" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:03:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Lock "cinder-quobyte-d44f8766-2511-43bd-8880-1a39698619da" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:03:04 devstack cinder-volume[87014]: INFO oslo.privsep.daemon [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbttxeww9/privsep.sock']
Nov 02 10:03:04 devstack sudo[88732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbttxeww9/privsep.sock
Nov 02 10:03:04 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Acquiring lock "cinder-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:03:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Lock "cinder-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:03:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Acquiring lock "cinder-quobyte-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:03:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Lock "cinder-quobyte-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b" acquired by "delete_volume" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:03:05 devstack cinder-volume[87014]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 02 10:03:05 devstack cinder-volume[87014]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 02 10:03:05 devstack cinder-volume[87014]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 02 10:03:05 devstack cinder-volume[87014]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 02 10:03:05 devstack cinder-volume[87014]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 02 10:03:05 devstack cinder-volume[87014]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 02 10:03:05 devstack cinder-volume[87014]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 02 10:03:05 devstack cinder-volume[87014]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 02 10:03:05 devstack cinder-volume[87014]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 02 10:03:06 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:06 devstack cinder-volume[87014]: INFO oslo.privsep.daemon [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Spawned new privsep daemon via rootwrap
Nov 02 10:03:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Accepted privsep connection to /tmp/tmpbttxeww9/privsep.sock {{(pid=87014) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 02 10:03:06 devstack cinder-volume[87014]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 10:03:06 devstack cinder-volume[87014]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 10:03:06 devstack cinder-volume[87014]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 02 10:03:06 devstack cinder-volume[87014]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88737
Nov 02 10:03:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a15e7c-15a9-4c60-8d47-5f9ea8ed7f48]: (2,) {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:03:06 devstack cinder-volume[87014]: WARNING oslo_privsep.priv_context [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] privsep daemon already running
Nov 02 10:03:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bcda46-b3f5-4bd9-b71c-322dd85d5aea]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:03:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1762bd-aee5-489e-b7c0-cda9c859308a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:03:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:03:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:03:06 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b
Nov 02 10:03:06 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:06 devstack sudo[88741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da
Nov 02 10:03:06 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:06 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b" returned: 0 in 0.817s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:03:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:03:07 devstack sudo[88751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b
Nov 02 10:03:07 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:07 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da" returned: 0 in 0.921s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:03:07 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da
Nov 02 10:03:07 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:03:07 devstack sudo[88755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:03:07 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:07 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b" returned: 0 in 0.734s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Lock "cinder-quobyte-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b" released by "delete_volume" :: held 2.356s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:03:07 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d44f8766-2511-43bd-8880-1a39698619da" returned: 0 in 0.702s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:03:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Lock "cinder-quobyte-d44f8766-2511-43bd-8880-1a39698619da" released by "delete_volume" :: held 3.384s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:03:08 devstack cinder-volume[87014]: WARNING cinder.quota [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:03:08 devstack cinder-volume[87014]: WARNING cinder.quota [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:03:08 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.862s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 8 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Created reservations ['34be7dff-305c-4d49-90b5-101a366442c5', '6d9dc70e-552a-4bba-825a-dcf1448828ac', '3b67aa20-a105-4056-a5d8-d99c2e739b1e', '02ec9aee-17e2-433f-b0bb-2652dc2eedd6'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Created reservations ['f6023cfe-16b6-4aa7-8f27-b611f34ef1f0', '83fce125-84de-470f-9dc2-f893dcc09121', 'c9e1af6f-5ef6-451b-a72b-e1d65f8d658c', '9c68bf4a-8826-4645-b277-2bd26f2a264b'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:03:08 devstack sudo[88763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:03:08 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:03:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:03:08 devstack sudo[88765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:03:08 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:09 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.751s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:03:09 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:09 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:03:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.910s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:03:09 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:03:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Deleted volume successfully.
Nov 02 10:03:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Deleted volume successfully.
Nov 02 10:03:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-811cb65c-510b-4242-bac2-4c4136621957 tempest-DeleteServersTestJSON-1801799298 None] Lock "cinder-d44f8766-2511-43bd-8880-1a39698619da-delete_volume" released by "delete_volume" :: held 5.135s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:03:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5650f76-abdd-4337-9e91-cb3b8ad4700a tempest-VolumesAdminNegativeTest-1162468077 None] Lock "cinder-da81d01d-b7e5-4d63-bb4e-0624dbcd0a4b-delete_volume" released by "delete_volume" :: held 4.239s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Flow 'volume_create_manager' (375485f7-d479-40c9-a873-c1d9f381aa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5259f277-713a-40c5-b2c3-c6da3f5868df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5259f277-713a-40c5-b2c3-c6da3f5868df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1294486341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8afb53-26a1-4014-90f3-0af71805bba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb90918be4440bdac6767f88a9b9e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:16Z,use_quota=True,user_id='ff7de36efec6426db6968edb54452f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f9aaf6-f4a6-4f63-b910-06a8056de78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f9aaf6-f4a6-4f63-b910-06a8056de78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf47cee-9b7f-4c79-8c47-7deedf001226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf47cee-9b7f-4c79-8c47-7deedf001226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8afb53-26a1-4014-90f3-0af71805bba9', 'volume_name': 'volume-8e8afb53-26a1-4014-90f3-0af71805bba9', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308ed7d4-6c48-4220-b747-96ac737e026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (308ed7d4-6c48-4220-b747-96ac737e026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8076e6-4bb6-4571-95f2-803e37a88b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:15 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Volume 8e8afb53-26a1-4014-90f3-0af71805bba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8afb53-26a1-4014-90f3-0af71805bba9', 'volume_size': 1}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1294486341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8afb53-26a1-4014-90f3-0af71805bba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb90918be4440bdac6767f88a9b9e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:03:16Z,use_quota=True,user_id='ff7de36efec6426db6968edb54452f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Creating volume 8e8afb53-26a1-4014-90f3-0af71805bba9 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:03:15 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:03:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:03:15 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9 1073741824
Nov 02 10:03:15 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:16 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9 1073741824" returned: 0 in 0.678s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:03:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:03:16 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9
Nov 02 10:03:16 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:03:16 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Nov 02 10:03:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9" returned: 0 in 0.380s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:03:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:03:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:03:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8076e6-4bb6-4571-95f2-803e37a88b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8afb53-26a1-4014-90f3-0af71805bba9', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450141a9-c6c0-43a2-9dd1-f6f5078298bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:03:17 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Volume volume-8e8afb53-26a1-4014-90f3-0af71805bba9 (8e8afb53-26a1-4014-90f3-0af71805bba9): created successfully
Nov 02 10:03:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450141a9-c6c0-43a2-9dd1-f6f5078298bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:03:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Flow 'volume_create_manager' (375485f7-d479-40c9-a873-c1d9f381aa88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:03:17 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9abeb6ec-41a0-4225-b5e4-865e65ec06ba tempest-AttachVolumeTestJSON-1777701880 None] Created volume successfully.
Nov 02 10:03:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-45d92cdf-0ea8-45e0-af43-e5a95584f45f req-7600e135-bb97-4a48-b864-77433ca45b50 tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:03:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-45d92cdf-0ea8-45e0-af43-e5a95584f45f req-7600e135-bb97-4a48-b864-77433ca45b50 tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:03:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-45d92cdf-0ea8-45e0-af43-e5a95584f45f req-7600e135-bb97-4a48-b864-77433ca45b50 tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:03:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-45d92cdf-0ea8-45e0-af43-e5a95584f45f req-7600e135-bb97-4a48-b864-77433ca45b50 tempest-AttachVolumeTestJSON-1777701880 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-8e8afb53-26a1-4014-90f3-0af71805bba9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46d6d244-716e-4a41-896f-9e5ad299e1bb', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:03:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-45d92cdf-0ea8-45e0-af43-e5a95584f45f req-7600e135-bb97-4a48-b864-77433ca45b50 tempest-AttachVolumeTestJSON-1777701880 None] attachment_update completed successfully.
Nov 02 10:03:29 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:UPDATE=24,cinder:SELECT=38,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:03:29 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=23,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:04:07 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:04:07 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:04:07 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.365s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 9 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:04:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Flow 'volume_create_manager' (6f8c1ee5-1895-4304-bad3-8890210d6401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c006b833-fab2-4abc-a52a-48e522e6341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:29 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-1be8220b-fb11-467b-9e91-c4b17dbae9f4 req-13ad92f3-8abb-4053-9973-f860d96a9f53 tempest-AttachVolumeTestJSON-1777701880 None] Terminate volume connection completed successfully.
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-1be8220b-fb11-467b-9e91-c4b17dbae9f4 req-13ad92f3-8abb-4053-9973-f860d96a9f53 tempest-AttachVolumeTestJSON-1777701880 None] Deleting attachment 46d6d244-716e-4a41-896f-9e5ad299e1bb. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c006b833-fab2-4abc-a52a-48e522e6341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-177646268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e3450e-967b-4f46-b7cc-188410c7f180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcef23827778422a8ed62ab1b611e700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:29Z,use_quota=True,user_id='1e11cfd2dbf04245a3ecc74b98a8eae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3476eaa7-3e03-4687-8cab-65656df8ddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3476eaa7-3e03-4687-8cab-65656df8ddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303df8e1-1e77-4ddc-813a-3224bfdf1acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303df8e1-1e77-4ddc-813a-3224bfdf1acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e3450e-967b-4f46-b7cc-188410c7f180', 'volume_name': 'volume-17e3450e-967b-4f46-b7cc-188410c7f180', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63541f25-bdbf-476e-8467-333763b37974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63541f25-bdbf-476e-8467-333763b37974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582175ad-f10a-4005-add9-7573acf66489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:29 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Volume 17e3450e-967b-4f46-b7cc-188410c7f180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e3450e-967b-4f46-b7cc-188410c7f180', 'volume_size': 1}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-177646268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e3450e-967b-4f46-b7cc-188410c7f180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcef23827778422a8ed62ab1b611e700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:29Z,use_quota=True,user_id='1e11cfd2dbf04245a3ecc74b98a8eae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Creating volume 17e3450e-967b-4f46-b7cc-188410c7f180 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:04:29 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:04:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:04:29 devstack sudo[90140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180 1073741824
Nov 02 10:04:29 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:04:30 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root
Nov 02 10:04:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180 1073741824" returned: 0 in 1.261s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:04:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:04:30 devstack sudo[90204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180
Nov 02 10:04:30 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:04:31 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root
Nov 02 10:04:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180" returned: 0 in 0.485s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:04:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:04:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:04:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582175ad-f10a-4005-add9-7573acf66489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e3450e-967b-4f46-b7cc-188410c7f180', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ad893e-cc6b-4e5e-a292-76d8b75231a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:31 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Volume volume-17e3450e-967b-4f46-b7cc-188410c7f180 (17e3450e-967b-4f46-b7cc-188410c7f180): created successfully
Nov 02 10:04:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ad893e-cc6b-4e5e-a292-76d8b75231a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Flow 'volume_create_manager' (6f8c1ee5-1895-4304-bad3-8890210d6401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:04:31 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8fd5252e-b065-4566-971e-a49021ea44b6 tempest-TaggedAttachmentsTest-1005708931 None] Created volume successfully.
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Flow 'volume_create_manager' (5eb14560-ee7a-4042-a28c-fe34c30a8914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ada7cc3-25cd-47d7-98ab-6aa03005da7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ada7cc3-25cd-47d7-98ab-6aa03005da7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-637042467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc337a58-227d-4488-9703-daa0aedb6ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775b7d2dfb094994aa9c962ab5e92c4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:38Z,use_quota=True,user_id='69749f3912c44031a632751838251d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bc7620-9ceb-42fe-b8b2-4caaaecdf39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bc7620-9ceb-42fe-b8b2-4caaaecdf39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d04b0b-4e71-4184-8914-e0cf3e9a5b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d04b0b-4e71-4184-8914-e0cf3e9a5b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc337a58-227d-4488-9703-daa0aedb6ea8', 'volume_name': 'volume-bc337a58-227d-4488-9703-daa0aedb6ea8', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b64dde-556b-4e14-ba12-4ab22a87f01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b64dde-556b-4e14-ba12-4ab22a87f01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e2eb87-a7e3-4b30-9623-2dec4cf21715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:38 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Volume bc337a58-227d-4488-9703-daa0aedb6ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc337a58-227d-4488-9703-daa0aedb6ea8', 'volume_size': 1}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-637042467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc337a58-227d-4488-9703-daa0aedb6ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775b7d2dfb094994aa9c962ab5e92c4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:04:38Z,use_quota=True,user_id='69749f3912c44031a632751838251d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Creating volume bc337a58-227d-4488-9703-daa0aedb6ea8 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:04:38 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:04:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:04:38 devstack sudo[90305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8 1073741824
Nov 02 10:04:38 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:04:39 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root
Nov 02 10:04:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8 1073741824" returned: 0 in 1.489s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:04:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:04:40 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8
Nov 02 10:04:40 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:04:41 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Nov 02 10:04:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8" returned: 0 in 1.216s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:04:41 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] <== create_volume: return (3083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:04:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.086s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:04:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e2eb87-a7e3-4b30-9623-2dec4cf21715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc337a58-227d-4488-9703-daa0aedb6ea8', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6535dd8f-5fc4-4b3c-85bd-415c4b221e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:04:41 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Volume volume-bc337a58-227d-4488-9703-daa0aedb6ea8 (bc337a58-227d-4488-9703-daa0aedb6ea8): created successfully
Nov 02 10:04:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6535dd8f-5fc4-4b3c-85bd-415c4b221e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:04:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Flow 'volume_create_manager' (5eb14560-ee7a-4042-a28c-fe34c30a8914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:04:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-500b6f3e-067e-4997-960b-8774c6b2d12a tempest-ServerRescueNegativeTestJSON-1482372897 None] Created volume successfully.
Nov 02 10:04:51 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:04:51 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:05:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Acquiring lock "cinder-bc337a58-227d-4488-9703-daa0aedb6ea8-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:05:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Lock "cinder-bc337a58-227d-4488-9703-daa0aedb6ea8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:05:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Acquiring lock "cinder-quobyte-bc337a58-227d-4488-9703-daa0aedb6ea8" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:05:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Lock "cinder-quobyte-bc337a58-227d-4488-9703-daa0aedb6ea8" acquired by "delete_volume" :: waited 0.030s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:05:03 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf36b7e-f648-44fe-9d71-9fe4debf141f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:05:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:05:03 devstack sudo[90658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8
Nov 02 10:05:03 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:05:03 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root
Nov 02 10:05:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8" returned: 0 in 0.613s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:05:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:05:03 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8
Nov 02 10:05:03 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:05:04 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Nov 02 10:05:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bc337a58-227d-4488-9703-daa0aedb6ea8" returned: 0 in 0.630s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:05:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Lock "cinder-quobyte-bc337a58-227d-4488-9703-daa0aedb6ea8" released by "delete_volume" :: held 1.343s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:05:04 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Created reservations ['204465f3-b343-47f5-bda3-d5ee964422be', '23e03f35-c170-4aa3-bf70-a72c1a365dc1', 'bd6dccf6-387b-4b0c-85b6-b178a217dac4', '4a1c3b54-1807-4ebb-b7d5-cd3c2b50170d'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:05:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:05:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:05:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:05:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:05:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:05:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:05:04 devstack sudo[90673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:05:04 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:05:05 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root
Nov 02 10:05:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.728s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:05:05 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:05:05 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Deleted volume successfully.
Nov 02 10:05:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-920ba6b0-e63c-498a-a8fc-b818002cf47c tempest-ServerRescueNegativeTestJSON-1482372897 None] Lock "cinder-bc337a58-227d-4488-9703-daa0aedb6ea8-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:05:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:05:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:05:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:05:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:05:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:05:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:05:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:05:07 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:05:07 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:05:07 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Nov 02 10:05:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.736s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:05:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:05:14 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Flow 'volume_create_manager' (753fa837-8354-44e8-8b36-89d0c05837f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56e9964-02ef-47e2-9b67-88eb9cfe3e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56e9964-02ef-47e2-9b67-88eb9cfe3e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1014364559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1945130-875a-4b2a-bede-5b1fb3718f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449d9fe4639447ba0574b1218b53a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:25Z,use_quota=True,user_id='59afc3857a7d49e2a6427d9a5ba0958a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54e48af-dead-457d-ad00-1ac665290504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54e48af-dead-457d-ad00-1ac665290504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ffb0195-bd03-485e-903f-80b28e2156a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ffb0195-bd03-485e-903f-80b28e2156a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1945130-875a-4b2a-bede-5b1fb3718f04', 'volume_name': 'volume-e1945130-875a-4b2a-bede-5b1fb3718f04', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5a492e-739c-4b80-8e0c-5523c101f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5a492e-739c-4b80-8e0c-5523c101f542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d6dd49-cd7c-4ced-9af3-01c7819d99f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:05:24 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Volume e1945130-875a-4b2a-bede-5b1fb3718f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1945130-875a-4b2a-bede-5b1fb3718f04', 'volume_size': 1}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1014364559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1945130-875a-4b2a-bede-5b1fb3718f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449d9fe4639447ba0574b1218b53a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:05:25Z,use_quota=True,user_id='59afc3857a7d49e2a6427d9a5ba0958a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Creating volume e1945130-875a-4b2a-bede-5b1fb3718f04 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:05:24 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:05:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:05:24 devstack sudo[90813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04 1073741824
Nov 02 10:05:24 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:05:25 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root
Nov 02 10:05:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04 1073741824" returned: 0 in 0.582s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:05:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:05:25 devstack sudo[90821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04
Nov 02 10:05:25 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:05:25 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root
Nov 02 10:05:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04" returned: 0 in 0.307s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:05:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:05:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:05:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d6dd49-cd7c-4ced-9af3-01c7819d99f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1945130-875a-4b2a-bede-5b1fb3718f04', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:05:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6841717a-3c00-410c-b172-02cb14939e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:05:25 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Volume volume-e1945130-875a-4b2a-bede-5b1fb3718f04 (e1945130-875a-4b2a-bede-5b1fb3718f04): created successfully
Nov 02 10:05:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6841717a-3c00-410c-b172-02cb14939e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:05:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Flow 'volume_create_manager' (753fa837-8354-44e8-8b36-89d0c05837f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:05:25 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1fd2f048-b0ad-443b-8364-69bf3be64e7d tempest-ServerActionsTestOtherA-2119603493 None] Created volume successfully.
Nov 02 10:05:35 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:05:35 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:05:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-23547083-0253-4078-a37e-6c9d6a68d0b8 req-cc9267f2-7bdf-4b84-bf92-cfa66b3c4215 tempest-TaggedAttachmentsTest-1005708931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:05:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-23547083-0253-4078-a37e-6c9d6a68d0b8 req-cc9267f2-7bdf-4b84-bf92-cfa66b3c4215 tempest-TaggedAttachmentsTest-1005708931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:05:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-23547083-0253-4078-a37e-6c9d6a68d0b8 req-cc9267f2-7bdf-4b84-bf92-cfa66b3c4215 tempest-TaggedAttachmentsTest-1005708931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:05:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-23547083-0253-4078-a37e-6c9d6a68d0b8 req-cc9267f2-7bdf-4b84-bf92-cfa66b3c4215 tempest-TaggedAttachmentsTest-1005708931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-17e3450e-967b-4f46-b7cc-188410c7f180', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '125d8287-3642-4897-9e21-0adb4d4efe46', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:05:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-23547083-0253-4078-a37e-6c9d6a68d0b8 req-cc9267f2-7bdf-4b84-bf92-cfa66b3c4215 tempest-TaggedAttachmentsTest-1005708931 None] attachment_update completed successfully.
Nov 02 10:06:02 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-fd3cea38-d9e9-489b-b061-c76417b3f887 req-8d7874c3-0eca-490c-be2b-a2a0ccb6fbec tempest-TaggedAttachmentsTest-1005708931 None] Terminate volume connection completed successfully.
Nov 02 10:06:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-fd3cea38-d9e9-489b-b061-c76417b3f887 req-8d7874c3-0eca-490c-be2b-a2a0ccb6fbec tempest-TaggedAttachmentsTest-1005708931 None] Deleting attachment 125d8287-3642-4897-9e21-0adb4d4efe46. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:07 devstack sudo[91708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:06:07 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:07 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.492s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 9 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:06:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:06:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-39ba6294-01ce-4da3-a806-f16dca6e19fc req-891dcf71-4a6f-4d48-b660-f3950e30811d tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-39ba6294-01ce-4da3-a806-f16dca6e19fc req-891dcf71-4a6f-4d48-b660-f3950e30811d tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-39ba6294-01ce-4da3-a806-f16dca6e19fc req-891dcf71-4a6f-4d48-b660-f3950e30811d tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-39ba6294-01ce-4da3-a806-f16dca6e19fc req-891dcf71-4a6f-4d48-b660-f3950e30811d tempest-ServerActionsTestOtherA-2119603493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-e1945130-875a-4b2a-bede-5b1fb3718f04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa49feef-75f5-4b0f-9a97-913154d4ce88', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:06:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-39ba6294-01ce-4da3-a806-f16dca6e19fc req-891dcf71-4a6f-4d48-b660-f3950e30811d tempest-ServerActionsTestOtherA-2119603493 None] attachment_update completed successfully.
Nov 02 10:06:14 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-58709556-f6b9-4e8e-a9d6-882493484826 req-1ce758fe-59f7-4882-ac7d-0165cd657a55 tempest-ServerActionsTestOtherA-2119603493 None] Terminate volume connection completed successfully.
Nov 02 10:06:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-58709556-f6b9-4e8e-a9d6-882493484826 req-1ce758fe-59f7-4882-ac7d-0165cd657a55 tempest-ServerActionsTestOtherA-2119603493 None] Deleting attachment fa49feef-75f5-4b0f-9a97-913154d4ce88. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:06:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-58709556-f6b9-4e8e-a9d6-882493484826 req-b484aee6-3bf8-4ff9-9172-954e0c6529db tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-58709556-f6b9-4e8e-a9d6-882493484826 req-b484aee6-3bf8-4ff9-9172-954e0c6529db tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-58709556-f6b9-4e8e-a9d6-882493484826 req-b484aee6-3bf8-4ff9-9172-954e0c6529db tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-58709556-f6b9-4e8e-a9d6-882493484826 req-b484aee6-3bf8-4ff9-9172-954e0c6529db tempest-ServerActionsTestOtherA-2119603493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-e1945130-875a-4b2a-bede-5b1fb3718f04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '033b4f1c-20a7-4708-bd54-23a28efdb086', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:06:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-58709556-f6b9-4e8e-a9d6-882493484826 req-b484aee6-3bf8-4ff9-9172-954e0c6529db tempest-ServerActionsTestOtherA-2119603493 None] attachment_update completed successfully.
Nov 02 10:06:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Acquiring lock "cinder-17e3450e-967b-4f46-b7cc-188410c7f180-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:06:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Lock "cinder-17e3450e-967b-4f46-b7cc-188410c7f180-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:06:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Acquiring lock "cinder-quobyte-17e3450e-967b-4f46-b7cc-188410c7f180" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:06:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Lock "cinder-quobyte-17e3450e-967b-4f46-b7cc-188410c7f180" acquired by "delete_volume" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:06:17 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9c39f-09af-4843-9003-76081b41c309]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:06:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:17 devstack sudo[92383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180
Nov 02 10:06:17 devstack sudo[92383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:17 devstack sudo[92383]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180" returned: 0 in 0.607s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:17 devstack sudo[92798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180
Nov 02 10:06:17 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:18 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-17e3450e-967b-4f46-b7cc-188410c7f180" returned: 0 in 0.388s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Lock "cinder-quobyte-17e3450e-967b-4f46-b7cc-188410c7f180" released by "delete_volume" :: held 1.045s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Created reservations ['6337802a-39b3-41f1-aeec-a61923957251', '5c56f6df-3c0c-451e-b101-d5d507f76f79', 'cc5434a1-0057-4e5f-a972-01a45f77e875', 'e5e49edc-f765-40fa-a8de-96872482c660'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:18 devstack sudo[92821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:06:18 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:18 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.270s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:06:18 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Deleted volume successfully.
Nov 02 10:06:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d4d1d9f-8753-45b6-8674-6af7a08aff55 tempest-TaggedAttachmentsTest-1005708931 None] Lock "cinder-17e3450e-967b-4f46-b7cc-188410c7f180-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Flow 'volume_create_manager' (4f63468d-2bea-439f-8f6a-33d53c35d3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf102ea-563a-4bba-b624-5c46281fe635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf102ea-563a-4bba-b624-5c46281fe635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-623064468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c57b5c7-5daa-47aa-9f05-5f1180954c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb90918be4440bdac6767f88a9b9e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:21Z,use_quota=True,user_id='ff7de36efec6426db6968edb54452f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6589eb-78b0-4227-ae7b-8a26edddb621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6589eb-78b0-4227-ae7b-8a26edddb621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16bd404-c427-43f1-8c79-28186e2ab0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16bd404-c427-43f1-8c79-28186e2ab0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c57b5c7-5daa-47aa-9f05-5f1180954c58', 'volume_name': 'volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0f4bc1-a068-41ef-9cb5-acc26676c244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0f4bc1-a068-41ef-9cb5-acc26676c244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd35d89-7d87-4d10-af25-5817b77c75af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:20 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Volume 3c57b5c7-5daa-47aa-9f05-5f1180954c58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58', 'volume_size': 1}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-623064468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c57b5c7-5daa-47aa-9f05-5f1180954c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb90918be4440bdac6767f88a9b9e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:21Z,use_quota=True,user_id='ff7de36efec6426db6968edb54452f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Creating volume 3c57b5c7-5daa-47aa-9f05-5f1180954c58 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:06:20 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:06:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:20 devstack sudo[92830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58 1073741824
Nov 02 10:06:20 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:21 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58 1073741824" returned: 0 in 0.748s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:21 devstack sudo[92837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58
Nov 02 10:06:21 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:22 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58" returned: 0 in 0.458s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:06:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd35d89-7d87-4d10-af25-5817b77c75af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d02db56-7e64-4f37-a4ea-48867920c5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:22 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Volume volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58 (3c57b5c7-5daa-47aa-9f05-5f1180954c58): created successfully
Nov 02 10:06:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d02db56-7e64-4f37-a4ea-48867920c5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Flow 'volume_create_manager' (4f63468d-2bea-439f-8f6a-33d53c35d3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:06:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-aa30f824-2424-4521-a214-afb8570dde4e tempest-AttachVolumeTestJSON-1777701880 None] Created volume successfully.
Nov 02 10:06:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-d5cf8c5e-7c75-4b81-bb23-06a0a5a2b582 req-0d8c4dbc-c981-4f67-b186-75eb6850904e tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-d5cf8c5e-7c75-4b81-bb23-06a0a5a2b582 req-0d8c4dbc-c981-4f67-b186-75eb6850904e tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-d5cf8c5e-7c75-4b81-bb23-06a0a5a2b582 req-0d8c4dbc-c981-4f67-b186-75eb6850904e tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:23 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-d5cf8c5e-7c75-4b81-bb23-06a0a5a2b582 req-0d8c4dbc-c981-4f67-b186-75eb6850904e tempest-AttachVolumeTestJSON-1777701880 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f598dd10-5cea-455c-bfc2-04144a7cdc5e', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:06:23 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-d5cf8c5e-7c75-4b81-bb23-06a0a5a2b582 req-0d8c4dbc-c981-4f67-b186-75eb6850904e tempest-AttachVolumeTestJSON-1777701880 None] attachment_update completed successfully.
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Flow 'volume_create_manager' (2f5b86fd-3571-4ff8-b5e7-245467955e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03efff0-fe6a-4da9-971c-52585baeaa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03efff0-fe6a-4da9-971c-52585baeaa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1765523653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d096065d6ce24ed49fd825c9046dd9ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:24Z,use_quota=True,user_id='d3c4e15d113e4c3cb2db2d29db9382a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65522ee2-1221-4d53-89cd-e7500e0608dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65522ee2-1221-4d53-89cd-e7500e0608dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896d37ee-5c62-4390-82d1-0ba1d2e31fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896d37ee-5c62-4390-82d1-0ba1d2e31fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c', 'volume_name': 'volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d4451d-6106-4845-be05-eaba7d39057c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d4451d-6106-4845-be05-eaba7d39057c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20b3f56-ccbc-4442-a1b7-7ae2afb0f0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:24 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Volume 3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c', 'volume_size': 1}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1765523653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d096065d6ce24ed49fd825c9046dd9ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:24Z,use_quota=True,user_id='d3c4e15d113e4c3cb2db2d29db9382a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Creating volume 3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:06:24 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:06:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:24 devstack sudo[92859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c 1073741824
Nov 02 10:06:24 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:25 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c 1073741824" returned: 0 in 0.520s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:25 devstack sudo[92865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c
Nov 02 10:06:25 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:25 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c" returned: 0 in 0.426s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:06:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20b3f56-ccbc-4442-a1b7-7ae2afb0f0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd89e088-5523-4a29-8294-32b9f6701013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:26 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Volume volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c (3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c): created successfully
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd89e088-5523-4a29-8294-32b9f6701013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Flow 'volume_create_manager' (2f5b86fd-3571-4ff8-b5e7-245467955e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:06:26 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-de8c3667-a5e7-4c54-8899-5f66ef565a19 tempest-AttachVolumeShelveTestJSON-432590654 None] Created volume successfully.
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Flow 'volume_create_manager' (5e2bd862-11ed-4da4-9dc6-d9bfe89b15aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9934587-52dc-49b0-9fde-6a8c1261dbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9934587-52dc-49b0-9fde-6a8c1261dbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1263895240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860a0962-7f3d-42db-8c17-549be6b6fb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb90918be4440bdac6767f88a9b9e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:27Z,use_quota=True,user_id='ff7de36efec6426db6968edb54452f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f090b10-ecdc-4e0f-9b67-8926cf56381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f090b10-ecdc-4e0f-9b67-8926cf56381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbdc7d4-381c-435f-9128-a87950b79e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbdc7d4-381c-435f-9128-a87950b79e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '860a0962-7f3d-42db-8c17-549be6b6fb94', 'volume_name': 'volume-860a0962-7f3d-42db-8c17-549be6b6fb94', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83924b7-bf3d-4a5a-9238-c93557ef0ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83924b7-bf3d-4a5a-9238-c93557ef0ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d124fd5-d500-44aa-a200-90ff8d2bf8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:26 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Volume 860a0962-7f3d-42db-8c17-549be6b6fb94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-860a0962-7f3d-42db-8c17-549be6b6fb94', 'volume_size': 1}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1263895240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860a0962-7f3d-42db-8c17-549be6b6fb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb90918be4440bdac6767f88a9b9e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:27Z,use_quota=True,user_id='ff7de36efec6426db6968edb54452f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Creating volume 860a0962-7f3d-42db-8c17-549be6b6fb94 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:06:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:06:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:06:27 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:06:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:27 devstack sudo[92874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94 1073741824
Nov 02 10:06:27 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:27 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94 1073741824" returned: 0 in 0.593s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:27 devstack sudo[92880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94
Nov 02 10:06:27 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:28 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94" returned: 0 in 0.394s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:06:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d124fd5-d500-44aa-a200-90ff8d2bf8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860a0962-7f3d-42db-8c17-549be6b6fb94', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae72e841-dc68-4134-8e01-5a33e0f54408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:28 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Volume volume-860a0962-7f3d-42db-8c17-549be6b6fb94 (860a0962-7f3d-42db-8c17-549be6b6fb94): created successfully
Nov 02 10:06:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae72e841-dc68-4134-8e01-5a33e0f54408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Flow 'volume_create_manager' (5e2bd862-11ed-4da4-9dc6-d9bfe89b15aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:06:28 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-12770c38-4713-4b18-82b3-3c64ae763b2e tempest-AttachVolumeTestJSON-1777701880 None] Created volume successfully.
Nov 02 10:06:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-10321c1b-f577-4fd2-99a3-603fa96f4d15 req-f8079fa6-a62a-4b8a-a8f1-87857303fffe tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-10321c1b-f577-4fd2-99a3-603fa96f4d15 req-f8079fa6-a62a-4b8a-a8f1-87857303fffe tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-10321c1b-f577-4fd2-99a3-603fa96f4d15 req-f8079fa6-a62a-4b8a-a8f1-87857303fffe tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-10321c1b-f577-4fd2-99a3-603fa96f4d15 req-f8079fa6-a62a-4b8a-a8f1-87857303fffe tempest-AttachVolumeTestJSON-1777701880 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-860a0962-7f3d-42db-8c17-549be6b6fb94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97741d97-dbcc-4e41-bcaa-4d130c3d8456', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:06:30 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-10321c1b-f577-4fd2-99a3-603fa96f4d15 req-f8079fa6-a62a-4b8a-a8f1-87857303fffe tempest-AttachVolumeTestJSON-1777701880 None] attachment_update completed successfully.
Nov 02 10:06:33 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-588ddc8e-18eb-4514-a43e-ccd51cefa70b req-e87f206b-f430-448a-88e5-8f7385216c96 tempest-AttachVolumeTestJSON-1777701880 None] Terminate volume connection completed successfully.
Nov 02 10:06:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-588ddc8e-18eb-4514-a43e-ccd51cefa70b req-e87f206b-f430-448a-88e5-8f7385216c96 tempest-AttachVolumeTestJSON-1777701880 None] Deleting attachment f598dd10-5cea-455c-bfc2-04144a7cdc5e. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:06:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-569d9241-1f30-4175-8cd5-f3acae81bc13 req-bc82d700-db4c-45fa-b662-1fb27da90de4 tempest-AttachVolumeTestJSON-1777701880 None] Terminate volume connection completed successfully.
Nov 02 10:06:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-569d9241-1f30-4175-8cd5-f3acae81bc13 req-bc82d700-db4c-45fa-b662-1fb27da90de4 tempest-AttachVolumeTestJSON-1777701880 None] Deleting attachment 97741d97-dbcc-4e41-bcaa-4d130c3d8456. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:06:43 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=47,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:06:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-c603cbf1-4960-4e08-8465-7a5b01f0a448 req-2f37e4f4-060e-4d80-b393-9fa70359c647 tempest-ServerActionsTestOtherA-2119603493 None] Terminate volume connection completed successfully.
Nov 02 10:06:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-c603cbf1-4960-4e08-8465-7a5b01f0a448 req-2f37e4f4-060e-4d80-b393-9fa70359c647 tempest-ServerActionsTestOtherA-2119603493 None] Deleting attachment 033b4f1c-20a7-4708-bd54-23a28efdb086. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:06:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-dfbf6a7f-a948-45e7-bd41-e2a79c84e5b9 req-b4ba1148-8801-45c9-8cbd-671f1b4c60d7 tempest-AttachVolumeShelveTestJSON-432590654 None] No connector for attachment 6be54513-dc71-4f50-8474-876159ee29fd; skipping storage backend terminate_connection call. {{(pid=87014) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 02 10:06:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-dfbf6a7f-a948-45e7-bd41-e2a79c84e5b9 req-b4ba1148-8801-45c9-8cbd-671f1b4c60d7 tempest-AttachVolumeShelveTestJSON-432590654 None] Deleting attachment 6be54513-dc71-4f50-8474-876159ee29fd. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:06:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "cinder-860a0962-7f3d-42db-8c17-549be6b6fb94-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:06:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-860a0962-7f3d-42db-8c17-549be6b6fb94-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:06:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "cinder-quobyte-860a0962-7f3d-42db-8c17-549be6b6fb94" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:06:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-quobyte-860a0962-7f3d-42db-8c17-549be6b6fb94" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:06:49 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f11bae-6822-4f3d-90c5-bb63827e13ca]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:06:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:50 devstack sudo[93052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94
Nov 02 10:06:50 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:50 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94" returned: 0 in 0.659s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:50 devstack sudo[93058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94
Nov 02 10:06:50 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:50 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-860a0962-7f3d-42db-8c17-549be6b6fb94" returned: 0 in 0.433s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-quobyte-860a0962-7f3d-42db-8c17-549be6b6fb94" released by "delete_volume" :: held 1.177s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:06:51 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Created reservations ['0ebd39fe-dcf8-44a0-af0d-520b45cb2000', '7fbee356-1b70-43d4-9561-b21a0c374cbf', '88182cdf-c19a-4d05-bdc6-89526c8dd674', '3bfe0202-2d26-41df-9d69-48ed569b6f23'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:06:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:06:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:06:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:51 devstack sudo[93061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:06:51 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:51 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.290s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:51 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:06:51 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Deleted volume successfully.
Nov 02 10:06:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-807ccfdd-d3b4-42c5-af85-47a1a27a097b tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-860a0962-7f3d-42db-8c17-549be6b6fb94-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:06:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "cinder-3c57b5c7-5daa-47aa-9f05-5f1180954c58-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:06:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-3c57b5c7-5daa-47aa-9f05-5f1180954c58-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:06:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "cinder-quobyte-3c57b5c7-5daa-47aa-9f05-5f1180954c58" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:06:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-quobyte-3c57b5c7-5daa-47aa-9f05-5f1180954c58" acquired by "delete_volume" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:06:52 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c0dc57-93a1-4bd9-b550-655c9c52c264]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:06:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:52 devstack sudo[93064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58
Nov 02 10:06:52 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:52 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58" returned: 0 in 0.504s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:52 devstack sudo[93069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58
Nov 02 10:06:52 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:52 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3c57b5c7-5daa-47aa-9f05-5f1180954c58" returned: 0 in 0.323s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-quobyte-3c57b5c7-5daa-47aa-9f05-5f1180954c58" released by "delete_volume" :: held 0.889s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Created reservations ['816f7b49-5f7b-40e0-89c4-95b38e6c6b02', '63a1ea7d-4d81-41c8-b32e-8b612b2f2581', '1f37eac4-383f-4256-a511-93c34ebdab31', '7222ff48-206a-4555-ad34-732dffc7791e'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:53 devstack sudo[93072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:06:53 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "cinder-8e8afb53-26a1-4014-90f3-0af71805bba9-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-8e8afb53-26a1-4014-90f3-0af71805bba9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "cinder-quobyte-8e8afb53-26a1-4014-90f3-0af71805bba9" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:06:53 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-quobyte-8e8afb53-26a1-4014-90f3-0af71805bba9" acquired by "delete_volume" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.430s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:06:53 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Deleted volume successfully.
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[71293e7d-1c46-435e-acf9-00cfd4c8379a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1fcff1c7-3a5d-4b91-906e-f294b5e543d3 tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-3c57b5c7-5daa-47aa-9f05-5f1180954c58-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:06:53 devstack sudo[93075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9
Nov 02 10:06:53 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:54 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9" returned: 0 in 0.569s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:54 devstack sudo[93081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9
Nov 02 10:06:54 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:54 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e8afb53-26a1-4014-90f3-0af71805bba9" returned: 0 in 0.463s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Flow 'volume_create_manager' (6954f9ac-1e6d-474b-aa93-e183cf19577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24d2784-3c09-428c-9e3e-56495a1ab6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-quobyte-8e8afb53-26a1-4014-90f3-0af71805bba9" released by "delete_volume" :: held 1.163s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24d2784-3c09-428c-9e3e-56495a1ab6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-818611318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef4f554-b0c9-4a92-82df-5d70fa0aa32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449d9fe4639447ba0574b1218b53a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:55Z,use_quota=True,user_id='59afc3857a7d49e2a6427d9a5ba0958a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9597e9be-1e20-492a-b511-16b53c0c3519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9597e9be-1e20-492a-b511-16b53c0c3519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356c796b-7084-4023-9554-676f28dcb2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG cinder.image.glance [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Creating Keystone auth plugin from conf {{(pid=87014) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 02 10:06:54 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Created reservations ['59a12c0c-230a-4d7c-a679-ac6e0ce2bbfd', '47b829a6-380a-4f54-939e-c5d9104755d6', '0cf2ff08-7504-420a-9b1a-465ed6deaf6b', 'c3c93087-b18e-4679-81ed-9839bb9378bf'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:55 devstack sudo[93084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:06:55 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356c796b-7084-4023-9554-676f28dcb2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ef4f554-b0c9-4a92-82df-5d70fa0aa32e', 'volume_name': 'volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f396cabd0>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9882c6-006d-4a56-91e8-768cf1f563c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9882c6-006d-4a56-91e8-768cf1f563c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a836b2f-0c5b-44c9-a13f-a532f30db1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:06:55 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Volume 2ef4f554-b0c9-4a92-82df-5d70fa0aa32e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f396cabd0>}
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Trying to clone 2ef4f554-b0c9-4a92-82df-5d70fa0aa32e from image c35ca8ac-fc2e-4930-9230-8b67e658a8ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]). {{(pid=87014) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 02 10:06:55 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.480s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:06:55 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Deleted volume successfully.
Nov 02 10:06:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-11045941-bec0-4e22-8c05-a188d567fb69 tempest-AttachVolumeTestJSON-1777701880 None] Lock "cinder-8e8afb53-26a1-4014-90f3-0af71805bba9-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:06:56 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 02 10:06:56 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Image download 20.69 MB at 20.69 MB/s
Nov 02 10:06:56 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f52a4b6-a145-4c00-b933-ef53fcbc35a4]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:06:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:56 devstack sudo[93114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD
Nov 02 10:06:56 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:56 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD" returned: 0 in 0.649s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:56 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Temporary image c35ca8ac-fc2e-4930-9230-8b67e658a8ae is fetched for user 59afc3857a7d49e2a6427d9a5ba0958a. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=59,cinder:UPDATE=52,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e9cef0-9451-4bc1-af29-6929024667f7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:57 devstack sudo[93119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD
Nov 02 10:06:57 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:57 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD" returned: 0 in 0.681s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-818611318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef4f554-b0c9-4a92-82df-5d70fa0aa32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449d9fe4639447ba0574b1218b53a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:06:55Z,use_quota=True,user_id='59afc3857a7d49e2a6427d9a5ba0958a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Creating volume 2ef4f554-b0c9-4a92-82df-5d70fa0aa32e {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:06:57 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:06:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:57 devstack sudo[93126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e 1073741824
Nov 02 10:06:57 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:58 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e 1073741824" returned: 0 in 0.681s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:58 devstack sudo[93148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e
Nov 02 10:06:58 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:59 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e" returned: 0 in 0.508s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:06:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:06:59 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Attempting download of c35ca8ac-fc2e-4930-9230-8b67e658a8ae ((None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}])) to volume 2ef4f554-b0c9-4a92-82df-5d70fa0aa32e. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 02 10:06:59 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c246ec07-2ea2-4802-8f1a-881c8d546eea]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:06:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_tfqnc44w {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:59 devstack sudo[93162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_tfqnc44w
Nov 02 10:06:59 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:06:59 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root
Nov 02 10:06:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_tfqnc44w" returned: 0 in 0.506s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:06:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_tfqnc44w {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:06:59 devstack sudo[93177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_tfqnc44w
Nov 02 10:06:59 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:00 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_tfqnc44w" returned: 1 in 0.599s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_tfqnc44w' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:07:00 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e213193e-35c4-4b60-8f0c-5ad446bab14d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:07:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:07:00 devstack sudo[93182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD
Nov 02 10:07:00 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:00 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:00 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] c35ca8ac-fc2e-4930-9230-8b67e658a8ae was qcow2, converting to qcow2 {{(pid=87014) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 02 10:07:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:07:00 devstack sudo[93187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e
Nov 02 10:07:00 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:04 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e" returned: 0 in 3.621s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:04 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_ezvr43dcdevstack@QuobyteHD, size 112.00 MB, duration 3.62 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:07:04 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Converted 112.00 MB image at 30.91 MB/s
Nov 02 10:07:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:07:04 devstack sudo[93311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e 1G
Nov 02 10:07:04 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:05 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e 1G" returned: 0 in 1.044s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:05 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Downloaded image c35ca8ac-fc2e-4930-9230-8b67e658a8ae ((None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}])) to volume 2ef4f554-b0c9-4a92-82df-5d70fa0aa32e successfully. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 02 10:07:05 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Temporary image c35ca8ac-fc2e-4930-9230-8b67e658a8ae for user 59afc3857a7d49e2a6427d9a5ba0958a is deleted. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 02 10:07:05 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Marking volume 2ef4f554-b0c9-4a92-82df-5d70fa0aa32e as bootable. {{(pid=87014) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 02 10:07:05 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Copying metadata from image c35ca8ac-fc2e-4930-9230-8b67e658a8ae to 2ef4f554-b0c9-4a92-82df-5d70fa0aa32e. {{(pid=87014) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 02 10:07:05 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Creating volume glance metadata for volume 2ef4f554-b0c9-4a92-82df-5d70fa0aa32e backed by image c35ca8ac-fc2e-4930-9230-8b67e658a8ae with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87014) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 02 10:07:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a836b2f-0c5b-44c9-a13f-a532f30db1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f396cabd0>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42607e08-2afa-4cdc-9726-4c354f55fdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:05 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Volume volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e (2ef4f554-b0c9-4a92-82df-5d70fa0aa32e): created successfully
Nov 02 10:07:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42607e08-2afa-4cdc-9726-4c354f55fdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Flow 'volume_create_manager' (6954f9ac-1e6d-474b-aa93-e183cf19577d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:07:05 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-586cf8e3-d7ec-4088-8be5-9e204b113335 tempest-ServerActionsTestOtherA-2119603493 None] Created volume successfully.
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:07:07 devstack sudo[93336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:07:07 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:07 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.438s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:07:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:07:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ba979271-8e4c-471b-b2b5-f99dd50463bc req-58ed3aba-531c-462e-a3b5-a5cb942228f4 tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:07:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ba979271-8e4c-471b-b2b5-f99dd50463bc req-58ed3aba-531c-462e-a3b5-a5cb942228f4 tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:07:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ba979271-8e4c-471b-b2b5-f99dd50463bc req-58ed3aba-531c-462e-a3b5-a5cb942228f4 tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.064s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:07:13 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-ba979271-8e4c-471b-b2b5-f99dd50463bc req-58ed3aba-531c-462e-a3b5-a5cb942228f4 tempest-ServerActionsTestOtherA-2119603493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d8af4c1-a87d-478a-8330-bf91ded813b0', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:07:13 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-ba979271-8e4c-471b-b2b5-f99dd50463bc req-58ed3aba-531c-462e-a3b5-a5cb942228f4 tempest-ServerActionsTestOtherA-2119603493 None] attachment_update completed successfully.
Nov 02 10:07:25 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=37,cinder:INSERT=10,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:07:25 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:UPDATE=7,cinder:INSERT=10,cinder:SELECT=13 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:07:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-ee506831-262f-4f11-b51f-6611f6512e1d req-8082ee26-f044-43cc-942f-4cea9cca3734 tempest-ServerActionsTestOtherA-2119603493 None] Terminate volume connection completed successfully.
Nov 02 10:07:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-ee506831-262f-4f11-b51f-6611f6512e1d req-8082ee26-f044-43cc-942f-4cea9cca3734 tempest-ServerActionsTestOtherA-2119603493 None] Deleting attachment 0d8af4c1-a87d-478a-8330-bf91ded813b0. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Flow 'volume_create_manager' (c2c9e9e9-518c-4693-b512-48c9bd52fbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f66c8f-bb80-4250-8d76-719f1325dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f66c8f-bb80-4250-8d76-719f1325dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-419116504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f2645b-b434-43e1-8b5c-b92dbb0c9369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e68740cfbc44899964e195d6637c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:50Z,use_quota=True,user_id='5e39142e35e94d0fa92bdff1b9b8a42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea9d62b-fd0c-40c3-8434-8565daf7af91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea9d62b-fd0c-40c3-8434-8565daf7af91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81e6f53-4d90-4f42-832c-5fb32c06632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81e6f53-4d90-4f42-832c-5fb32c06632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60f2645b-b434-43e1-8b5c-b92dbb0c9369', 'volume_name': 'volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d6ccf9-3f79-47f8-be89-12dc309ec551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d6ccf9-3f79-47f8-be89-12dc309ec551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4649a94a-1a3a-4cf6-8308-709571974330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:50 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Volume 60f2645b-b434-43e1-8b5c-b92dbb0c9369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369', 'volume_size': 1}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-419116504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f2645b-b434-43e1-8b5c-b92dbb0c9369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e68740cfbc44899964e195d6637c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:50Z,use_quota=True,user_id='5e39142e35e94d0fa92bdff1b9b8a42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Creating volume 60f2645b-b434-43e1-8b5c-b92dbb0c9369 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:07:50 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:07:50 devstack sudo[94137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369 1073741824
Nov 02 10:07:50 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Acquiring lock "cinder-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Lock "cinder-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Acquiring lock "cinder-quobyte-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Lock "cinder-quobyte-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c" acquired by "delete_volume" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[797c67ef-3e3b-4e93-988f-f5c2991b9a14]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:07:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:07:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ee506831-262f-4f11-b51f-6611f6512e1d req-dba2016b-d048-4768-9e31-f75f804879c7 tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:07:51 devstack sudo[94149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c
Nov 02 10:07:51 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:51 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369 1073741824" returned: 0 in 0.794s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:07:51 devstack sudo[94167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369
Nov 02 10:07:51 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:51 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c" returned: 0 in 0.688s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:07:51 devstack sudo[94196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c
Nov 02 10:07:51 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:52 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369" returned: 0 in 0.624s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ee506831-262f-4f11-b51f-6611f6512e1d req-dba2016b-d048-4768-9e31-f75f804879c7 tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.044s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4649a94a-1a3a-4cf6-8308-709571974330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c55fef-4ad3-400b-a6f6-f3af5158bd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ee506831-262f-4f11-b51f-6611f6512e1d req-dba2016b-d048-4768-9e31-f75f804879c7 tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.085s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:07:52 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:52 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Volume volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369 (60f2645b-b434-43e1-8b5c-b92dbb0c9369): created successfully
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c55fef-4ad3-400b-a6f6-f3af5158bd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Flow 'volume_create_manager' (c2c9e9e9-518c-4693-b512-48c9bd52fbef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c" returned: 0 in 0.584s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5ab41d80-e00b-4e06-a51d-d22b9e814d8b tempest-ServersNegativeTestJSON-1036355623 None] Created volume successfully.
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Lock "cinder-quobyte-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c" released by "delete_volume" :: held 1.395s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-ee506831-262f-4f11-b51f-6611f6512e1d req-dba2016b-d048-4768-9e31-f75f804879c7 tempest-ServerActionsTestOtherA-2119603493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39077726-e001-492f-8d01-de007930d78f', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Created reservations ['f377d9f8-7276-4a81-9319-6fb8fc5da8e7', '99b0f473-ce84-4e81-b307-25b84adbfa5a', 'dba8ef1e-1328-4e62-b262-620c96c9fa70', 'c8628af9-7042-488e-8e61-851a560de52a'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:07:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-ee506831-262f-4f11-b51f-6611f6512e1d req-dba2016b-d048-4768-9e31-f75f804879c7 tempest-ServerActionsTestOtherA-2119603493 None] attachment_update completed successfully.
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:07:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:07:52 devstack sudo[94228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:07:52 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:53 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.501s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:53 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:07:53 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Deleted volume successfully.
Nov 02 10:07:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-56bbec71-1893-403f-be9b-b60d4d68e704 tempest-AttachVolumeShelveTestJSON-432590654 None] Lock "cinder-3a3863fc-0e47-43cb-a4bc-e46d11ec7d6c-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Flow 'volume_create_manager' (59b12e91-9384-4376-bee9-4f43ad892fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d01349-7b93-49fe-98e3-9e4b2c7bad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d01349-7b93-49fe-98e3-9e4b2c7bad45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-121081139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bf6bc9-c0fd-4987-b6be-9f237054cf09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e68740cfbc44899964e195d6637c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:57Z,use_quota=True,user_id='5e39142e35e94d0fa92bdff1b9b8a42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c545454-bb72-4f7b-bbd0-573184a19a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c545454-bb72-4f7b-bbd0-573184a19a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a36e0b9-5049-4d46-af36-62d51a789e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a36e0b9-5049-4d46-af36-62d51a789e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bf6bc9-c0fd-4987-b6be-9f237054cf09', 'volume_name': 'volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b2beef-b897-4ecf-badb-fa065dc0122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b2beef-b897-4ecf-badb-fa065dc0122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5fb945-0d32-45d9-9f1f-dd4d355ac864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:57 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Volume 63bf6bc9-c0fd-4987-b6be-9f237054cf09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09', 'volume_size': 1}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-121081139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bf6bc9-c0fd-4987-b6be-9f237054cf09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e68740cfbc44899964e195d6637c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:07:57Z,use_quota=True,user_id='5e39142e35e94d0fa92bdff1b9b8a42a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Creating volume 63bf6bc9-c0fd-4987-b6be-9f237054cf09 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:07:57 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:07:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:07:57 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09 1073741824
Nov 02 10:07:57 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:58 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09 1073741824" returned: 0 in 1.003s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:07:58 devstack sudo[94701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09
Nov 02 10:07:58 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:07:58 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root
Nov 02 10:07:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09" returned: 0 in 0.355s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:07:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:07:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:07:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5fb945-0d32-45d9-9f1f-dd4d355ac864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dff276-11d3-4508-afbb-7b714e6b07e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:07:58 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Volume volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09 (63bf6bc9-c0fd-4987-b6be-9f237054cf09): created successfully
Nov 02 10:07:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dff276-11d3-4508-afbb-7b714e6b07e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:07:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Flow 'volume_create_manager' (59b12e91-9384-4376-bee9-4f43ad892fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:07:59 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-36b5f679-390f-469d-895d-1d3b565781e9 tempest-ServersNegativeTestJSON-1036355623 None] Created volume successfully.
Nov 02 10:08:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Acquiring lock "cinder-63bf6bc9-c0fd-4987-b6be-9f237054cf09-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Lock "cinder-63bf6bc9-c0fd-4987-b6be-9f237054cf09-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Acquiring lock "cinder-quobyte-63bf6bc9-c0fd-4987-b6be-9f237054cf09" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Lock "cinder-quobyte-63bf6bc9-c0fd-4987-b6be-9f237054cf09" acquired by "delete_volume" :: waited 0.135s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:01 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b852271-f806-47aa-94ac-fd58fbee1e96]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:08:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:01 devstack sudo[94708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09
Nov 02 10:08:01 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:02 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09" returned: 0 in 0.761s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:02 devstack sudo[94713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09
Nov 02 10:08:02 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:02 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-63bf6bc9-c0fd-4987-b6be-9f237054cf09" returned: 0 in 0.596s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Lock "cinder-quobyte-63bf6bc9-c0fd-4987-b6be-9f237054cf09" released by "delete_volume" :: held 1.517s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:02 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Created reservations ['a5f2f9a4-c124-4858-9ebf-ddc509d85371', '23697da0-348b-4f88-93af-acbddcd9c8c1', 'cb5e4038-01e9-447e-8b82-5f8f5a33b462', '70b2b6e6-3726-41a0-9aa4-ffb7be09fd6c'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:08:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:03 devstack sudo[94717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:08:03 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Acquiring lock "cinder-60f2645b-b434-43e1-8b5c-b92dbb0c9369-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Lock "cinder-60f2645b-b434-43e1-8b5c-b92dbb0c9369-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Acquiring lock "cinder-quobyte-60f2645b-b434-43e1-8b5c-b92dbb0c9369" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:04 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.883s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:04 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:08:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Lock "cinder-quobyte-60f2645b-b434-43e1-8b5c-b92dbb0c9369" acquired by "delete_volume" :: waited 0.086s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:04 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Deleted volume successfully.
Nov 02 10:08:04 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0738ab-ab60-4ae1-8b74-f4c7022a3595]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:08:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0c1765a1-7589-484b-9781-0a7d0e81c18a tempest-ServersNegativeTestJSON-1036355623 None] Lock "cinder-63bf6bc9-c0fd-4987-b6be-9f237054cf09-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:04 devstack sudo[94720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369
Nov 02 10:08:04 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:04 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369" returned: 0 in 0.805s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:05 devstack sudo[94727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369
Nov 02 10:08:05 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:05 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-60f2645b-b434-43e1-8b5c-b92dbb0c9369" returned: 0 in 0.750s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Lock "cinder-quobyte-60f2645b-b434-43e1-8b5c-b92dbb0c9369" released by "delete_volume" :: held 1.823s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:06 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Created reservations ['1b482bbe-79de-46ba-bc49-cb74b94dffb2', '3e85c3cc-1ebb-48ce-8f49-372d584e1954', '2877a2b6-02bb-491c-ba21-455ec123be5f', '7390a8d0-0928-491f-914e-ac3d8bd2fcc6'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:08:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:06 devstack sudo[94766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:08:06 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:07 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.604s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:08:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Deleted volume successfully.
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:07 devstack sudo[94770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:08:07 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-89a66a89-4d48-4278-b8df-cdc64f46a9a3 tempest-ServersNegativeTestJSON-1036355623 None] Lock "cinder-60f2645b-b434-43e1-8b5c-b92dbb0c9369-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:07 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.783s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:08:08 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:08:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:08:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:08:16 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=30,cinder:INSERT=5,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:08:17 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-41046548-4ed5-475e-92fc-1ddf9ea236e4 tempest-GroupSnapshotsV319Test-1017154922 None] Group tempest-GroupSnapshotsV319Test-Group-602524481: creating
Nov 02 10:08:17 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-41046548-4ed5-475e-92fc-1ddf9ea236e4 tempest-GroupSnapshotsV319Test-1017154922 None] Group tempest-GroupSnapshotsV319Test-Group-602524481: created successfully
Nov 02 10:08:17 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-41046548-4ed5-475e-92fc-1ddf9ea236e4 tempest-GroupSnapshotsV319Test-1017154922 None] Create group completed successfully.
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Flow 'volume_create_manager' (612fa8b0-d129-46b7-bdf0-b14d42435815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa216873-531d-489e-bf73-910c6ea896fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa216873-531d-489e-bf73-910c6ea896fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-518755514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=730e26f6-439b-403e-a800-3f5bc32c232e,host='devstack@QuobyteHD#QuobyteHD',id=e59ca45e-c53a-455f-9d42-a5c95d8a5dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921b0362b7194c669ac3ec41800ccbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:19Z,use_quota=True,user_id='fb295a8161ba4b4b91d83d3f7d423840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7b97b67-c3fb-4e63-9783-c745cf535e70),volume_type_id=b7b97b67-c3fb-4e63-9783-c745cf535e70)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3ed8a3-1e4f-495e-8b40-108cd7e9764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3ed8a3-1e4f-495e-8b40-108cd7e9764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af06bb9-cb78-4ad0-a65b-2dbfd0bd95be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af06bb9-cb78-4ad0-a65b-2dbfd0bd95be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e59ca45e-c53a-455f-9d42-a5c95d8a5dfd', 'volume_name': 'volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18629e8-a155-4b16-9e06-3ee477ed4d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18629e8-a155-4b16-9e06-3ee477ed4d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db8fbba-9697-4526-be29-ef31aca309e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:19 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Volume e59ca45e-c53a-455f-9d42-a5c95d8a5dfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd', 'volume_size': 1}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=730e26f6-439b-403e-a800-3f5bc32c232e,created_at=2026-11-02T09:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-518755514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=730e26f6-439b-403e-a800-3f5bc32c232e,host='devstack@QuobyteHD#QuobyteHD',id=e59ca45e-c53a-455f-9d42-a5c95d8a5dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921b0362b7194c669ac3ec41800ccbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:19Z,use_quota=True,user_id='fb295a8161ba4b4b91d83d3f7d423840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7b97b67-c3fb-4e63-9783-c745cf535e70),volume_type_id=b7b97b67-c3fb-4e63-9783-c745cf535e70)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Creating volume e59ca45e-c53a-455f-9d42-a5c95d8a5dfd {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:08:19 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:08:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:19 devstack sudo[94895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd 1073741824
Nov 02 10:08:19 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:20 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd 1073741824" returned: 0 in 0.676s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:20 devstack sudo[94902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd
Nov 02 10:08:20 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:20 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd" returned: 0 in 0.368s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db8fbba-9697-4526-be29-ef31aca309e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1d37b4-68d7-445d-9c9d-168f99c87695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:20 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Volume volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd (e59ca45e-c53a-455f-9d42-a5c95d8a5dfd): created successfully
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1d37b4-68d7-445d-9c9d-168f99c87695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Flow 'volume_create_manager' (612fa8b0-d129-46b7-bdf0-b14d42435815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:08:20 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-20019dda-5798-48f8-a9a6-c1698b799fab tempest-GroupSnapshotsV319Test-1017154922 None] Created volume successfully.
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Flow 'volume_create_manager' (2e56f293-6465-4b21-9400-6c660ceeead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5004fc-38af-4a9b-a482-ac7be38461b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5004fc-38af-4a9b-a482-ac7be38461b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-805938550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31900756-f2ac-46aa-adc9-15d041f9f3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c155532ec9b44ada95ef282f0e9126b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:21Z,use_quota=True,user_id='710560e50ca34d80aa75ef580db0be5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c27ce3-8dad-4a19-8b6a-ddc40a627fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c27ce3-8dad-4a19-8b6a-ddc40a627fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc7e3d6-4eb3-45ba-aaf5-7089a9ace398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc7e3d6-4eb3-45ba-aaf5-7089a9ace398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31900756-f2ac-46aa-adc9-15d041f9f3c9', 'volume_name': 'volume-31900756-f2ac-46aa-adc9-15d041f9f3c9', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d8deab-3da4-4bfa-88d7-4c7657033968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d8deab-3da4-4bfa-88d7-4c7657033968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cb8e24-8543-4cf0-b36c-8ddaa4708c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:20 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Volume 31900756-f2ac-46aa-adc9-15d041f9f3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31900756-f2ac-46aa-adc9-15d041f9f3c9', 'volume_size': 1}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-805938550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31900756-f2ac-46aa-adc9-15d041f9f3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c155532ec9b44ada95ef282f0e9126b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:21Z,use_quota=True,user_id='710560e50ca34d80aa75ef580db0be5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Creating volume 31900756-f2ac-46aa-adc9-15d041f9f3c9 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:08:20 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:08:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:21 devstack sudo[94905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9 1073741824
Nov 02 10:08:21 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:21 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9 1073741824" returned: 0 in 0.465s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:21 devstack sudo[94911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9
Nov 02 10:08:21 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:21 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9" returned: 0 in 0.298s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:08:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:21 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cb8e24-8543-4cf0-b36c-8ddaa4708c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31900756-f2ac-46aa-adc9-15d041f9f3c9', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:21 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9593d3-221e-4e4a-b148-465b9db6fbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:21 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Volume volume-31900756-f2ac-46aa-adc9-15d041f9f3c9 (31900756-f2ac-46aa-adc9-15d041f9f3c9): created successfully
Nov 02 10:08:21 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9593d3-221e-4e4a-b148-465b9db6fbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:21 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Flow 'volume_create_manager' (2e56f293-6465-4b21-9400-6c660ceeead8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:08:21 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2eb65520-3ab5-48cc-8073-a4f06b2baf9a tempest-AttachVolumeNegativeTest-1334827169 None] Created volume successfully.
Nov 02 10:08:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] GroupSnapshot 083c54ab-0271-4e76-abd7-06bd620d52be: creating.
Nov 02 10:08:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] Group snapshot 083c54ab-0271-4e76-abd7-06bd620d52be: creating. {{(pid=87014) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 02 10:08:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] Creating offline snapshot 86353f20-75ce-4586-8e67-c01e3129df6d of volume e59ca45e-c53a-455f-9d42-a5c95d8a5dfd {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:08:22 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3f6887-9122-4880-8d03-fb6bb8cdcf6c]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:08:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:22 devstack sudo[94914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd
Nov 02 10:08:22 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dedbe23a-ca13-46e1-81ad-5fcb98d980ef tempest-BackendsCapabilitiesAdminTestsJSON-535147575 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8322715759277, 'free_capacity_gb': 1773.8322715759277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87014) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 02 10:08:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4366ad2-21a2-4b9a-8859-8eab4d77ab67 tempest-BackendsCapabilitiesAdminTestsJSON-535147575 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8322715759277, 'free_capacity_gb': 1773.8322715759277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87014) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 02 10:08:22 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd" returned: 0 in 0.421s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:22 devstack sudo[94920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d 1G
Nov 02 10:08:22 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:23 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d 1G" returned: 0 in 0.493s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:23 devstack sudo[94929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d
Nov 02 10:08:23 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:23 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d" returned: 0 in 0.340s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:23 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:08:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:23 devstack sudo[94934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d
Nov 02 10:08:23 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:23 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d" returned: 0 in 0.297s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:23 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.info
Nov 02 10:08:23 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-d2332fd8-ffe6-4963-b94d-a22c261e9ef6 req-e1f13402-f0e2-45d1-aec3-0b06a769a96e tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:24 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.info" returned: 0 in 0.297s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:24 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:08:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:24 devstack sudo[94949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.info
Nov 02 10:08:24 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:24 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.info" returned: 0 in 0.282s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-d2332fd8-ffe6-4963-b94d-a22c261e9ef6 req-e1f13402-f0e2-45d1-aec3-0b06a769a96e tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.394s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-d2332fd8-ffe6-4963-b94d-a22c261e9ef6 req-e1f13402-f0e2-45d1-aec3-0b06a769a96e tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-d2332fd8-ffe6-4963-b94d-a22c261e9ef6 req-e1f13402-f0e2-45d1-aec3-0b06a769a96e tempest-AttachVolumeNegativeTest-1334827169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-31900756-f2ac-46aa-adc9-15d041f9f3c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05026c98-69ae-4af4-b768-aab76fc79389', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:08:24 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-07ac7022-040b-43bc-9a51-b4655713f2d7 tempest-GroupSnapshotsV319Test-1017154922 None] group_snapshot 083c54ab-0271-4e76-abd7-06bd620d52be: created successfully
Nov 02 10:08:24 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-d2332fd8-ffe6-4963-b94d-a22c261e9ef6 req-e1f13402-f0e2-45d1-aec3-0b06a769a96e tempest-AttachVolumeNegativeTest-1334827169 None] attachment_update completed successfully.
Nov 02 10:08:26 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] group_snapshot 083c54ab-0271-4e76-abd7-06bd620d52be: deleting
Nov 02 10:08:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] group_snapshot 083c54ab-0271-4e76-abd7-06bd620d52be: deleting {{(pid=87014) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 02 10:08:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Acquiring lock "cinder-quobyte-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Lock "cinder-quobyte-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Acquiring lock "cinder-quobyte-86353f20-75ce-4586-8e67-c01e3129df6d" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Lock "cinder-quobyte-86353f20-75ce-4586-8e67-c01e3129df6d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Deleting offline snapshot 86353f20-75ce-4586-8e67-c01e3129df6d of volume e59ca45e-c53a-455f-9d42-a5c95d8a5dfd {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:08:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] snapshot_file for this snap is: volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:08:26 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f1972a-310c-4149-bf43-0171ed291920]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:08:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:27 devstack sudo[94955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d
Nov 02 10:08:27 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:27 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d" returned: 0 in 0.579s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:08:27 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f5c0b6-f07e-43c6-ab0d-3a8d66ed35a7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:08:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:27 devstack sudo[94961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd
Nov 02 10:08:27 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:28 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd" returned: 0 in 0.538s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:28 devstack sudo[94970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d
Nov 02 10:08:28 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:28 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d" returned: 0 in 0.494s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:28 devstack sudo[94978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d
Nov 02 10:08:28 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:28 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd.86353f20-75ce-4586-8e67-c01e3129df6d" returned: 0 in 0.452s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:29 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Lock "cinder-quobyte-86353f20-75ce-4586-8e67-c01e3129df6d" released by "_delete_snapshot" :: held 2.293s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:29 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Lock "cinder-quobyte-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd" released by "delete_snapshot" :: held 2.338s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:29 devstack cinder-volume[87014]: WARNING cinder.quota [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-216581386 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-216581386, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:08:29 devstack cinder-volume[87014]: WARNING cinder.quota [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-216581386 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-216581386, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:08:29 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] Created reservations ['6e380309-1061-453b-b02e-27ae97556f2b', '930e4ddb-77a6-4846-a4ad-3a7881714aa6', 'b822df6a-c064-4627-9487-5190baf2272b', '06855855-10e0-4abf-8ed9-6050c59da1b7'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:08:29 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-518e6f26-8682-43dc-a3c2-24c294632472 tempest-GroupSnapshotsV319Test-1017154922 None] group_snapshot 083c54ab-0271-4e76-abd7-06bd620d52be: deleted successfully
Nov 02 10:08:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Acquiring lock "cinder-quobyte-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Lock "cinder-quobyte-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd" acquired by "delete_volume" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:30 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdae6f01-9e76-4e8c-b130-5dbd0f2fc424]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:08:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:30 devstack sudo[95006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd
Nov 02 10:08:30 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:31 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd" returned: 0 in 0.676s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:31 devstack sudo[95013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd
Nov 02 10:08:31 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Flow 'volume_create_manager' (fce6ad8b-a19a-416e-a917-47a783dcdebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18b25fa-766d-41b0-85d8-72282e39755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18b25fa-766d-41b0-85d8-72282e39755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-255359017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561481a6-338e-4a51-91b0-3c3288f4bf08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4bc238c3052431cadcbf595f99ffcaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:32Z,use_quota=True,user_id='37cf3d7c477d417f96ff100f7bbcc54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abd0a05-1487-48aa-8c71-61594dd6753d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abd0a05-1487-48aa-8c71-61594dd6753d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b782fbe-25b1-4ec7-a0e5-0ea4ac8c5e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b782fbe-25b1-4ec7-a0e5-0ea4ac8c5e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '561481a6-338e-4a51-91b0-3c3288f4bf08', 'volume_name': 'volume-561481a6-338e-4a51-91b0-3c3288f4bf08', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a20de9-e6d4-49f9-8047-fe585bf97438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a20de9-e6d4-49f9-8047-fe585bf97438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abea238e-842a-4431-a25b-6a6871705bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:31 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Volume 561481a6-338e-4a51-91b0-3c3288f4bf08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-561481a6-338e-4a51-91b0-3c3288f4bf08', 'volume_size': 1}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-255359017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561481a6-338e-4a51-91b0-3c3288f4bf08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4bc238c3052431cadcbf595f99ffcaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:32Z,use_quota=True,user_id='37cf3d7c477d417f96ff100f7bbcc54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Creating volume 561481a6-338e-4a51-91b0-3c3288f4bf08 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:08:31 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:31 devstack sudo[95016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08 1073741824
Nov 02 10:08:31 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:31 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd" returned: 0 in 0.556s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Lock "cinder-quobyte-e59ca45e-c53a-455f-9d42-a5c95d8a5dfd" released by "delete_volume" :: held 1.373s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:32 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-fd6bd7b3-398b-44d4-b646-02e8b2d35f7d tempest-ServerActionsTestOtherA-2119603493 None] Terminate volume connection completed successfully.
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-fd6bd7b3-398b-44d4-b646-02e8b2d35f7d tempest-ServerActionsTestOtherA-2119603493 None] Deleting attachment 39077726-e001-492f-8d01-de007930d78f. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Created reservations ['2fdafe79-29f6-44bd-9a0e-bccf34fade69'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:08:32 devstack cinder-volume[87014]: WARNING cinder.quota [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-216581386 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-216581386, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Created reservations ['d8126495-14f1-47df-b21f-12bda108d1db', '99d60a36-1b7f-49a2-940c-a884ee6cbad3', '6e11693d-31ab-426d-85e4-1bd0c4709a2b', '13c9ecc0-c10f-4fad-a814-627e71504af0'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "cinder-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Lock "cinder-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "cinder-quobyte-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Lock "cinder-quobyte-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e" acquired by "delete_volume" :: waited 0.090s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:32 devstack sudo[95025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:08:32 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6408244-341a-4c21-9980-3fddc51d89fa]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:32 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08 1073741824" returned: 0 in 1.008s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:32 devstack sudo[95027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e
Nov 02 10:08:32 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:32 devstack sudo[95029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08
Nov 02 10:08:32 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:32 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.446s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:32 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:08:32 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d8dd04e1-5cd7-4418-8200-8ff2c9324418 tempest-GroupSnapshotsV319Test-1017154922 None] Delete group completed successfully.
Nov 02 10:08:33 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e" returned: 0 in 0.778s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:33 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08" returned: 0 in 0.538s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:33 devstack sudo[95038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e
Nov 02 10:08:33 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abea238e-842a-4431-a25b-6a6871705bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-561481a6-338e-4a51-91b0-3c3288f4bf08', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf63825-39e1-4a60-ae97-d839d16eecc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:33 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Volume volume-561481a6-338e-4a51-91b0-3c3288f4bf08 (561481a6-338e-4a51-91b0-3c3288f4bf08): created successfully
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf63825-39e1-4a60-ae97-d839d16eecc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Flow 'volume_create_manager' (fce6ad8b-a19a-416e-a917-47a783dcdebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:08:33 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1199fe11-d4e4-4ba9-8441-3dfeb9c38857 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Created volume successfully.
Nov 02 10:08:33 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e" returned: 0 in 0.384s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Lock "cinder-quobyte-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e" released by "delete_volume" :: held 1.257s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:33 devstack cinder-volume[87014]: DEBUG cinder.quota [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Created reservations ['b1632f9c-a0a1-4c7a-9611-13264223ed88', '4687c9c6-9c10-4ffa-adf2-2976db01915b', '22214649-4e50-488b-a5a0-d9c23983190c', '65a9b4a6-dcaf-4018-8dc2-9b9ccb74e3c1'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:34 devstack sudo[95041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:08:34 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "cinder-e1945130-875a-4b2a-bede-5b1fb3718f04-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Lock "cinder-e1945130-875a-4b2a-bede-5b1fb3718f04-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "cinder-quobyte-e1945130-875a-4b2a-bede-5b1fb3718f04" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:34 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.564s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG cinder.manager [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Lock "cinder-quobyte-e1945130-875a-4b2a-bede-5b1fb3718f04" acquired by "delete_volume" :: waited 0.034s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:34 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Deleted volume successfully.
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80a4ffd-2c36-4b15-8cea-2953d67215c0]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-8b73136c-c046-4f95-aaf9-60bf225a84cd req-51abab02-9cde-410f-ba5b-b25853014b6a tempest-ServerActionsTestOtherA-2119603493 None] Lock "cinder-2ef4f554-b0c9-4a92-82df-5d70fa0aa32e-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:34 devstack sudo[95048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04
Nov 02 10:08:34 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:35 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04" returned: 0 in 0.637s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:35 devstack sudo[95063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04
Nov 02 10:08:35 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:35 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e1945130-875a-4b2a-bede-5b1fb3718f04" returned: 0 in 0.331s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Lock "cinder-quobyte-e1945130-875a-4b2a-bede-5b1fb3718f04" released by "delete_volume" :: held 1.130s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:35 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Created reservations ['645e1d3c-1b31-4e6a-855d-0acd622a7136', '602a8a9a-8836-4525-8173-a2e1b0d6bbb1', '89e68a06-683a-4a36-aa1a-624343a8ca49', '2887b88b-9c68-4795-916f-34f3ea6f2ce2'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:08:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:36 devstack sudo[95069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:08:36 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Acquiring lock "cinder-561481a6-338e-4a51-91b0-3c3288f4bf08-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Lock "cinder-561481a6-338e-4a51-91b0-3c3288f4bf08-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Acquiring lock "cinder-quobyte-561481a6-338e-4a51-91b0-3c3288f4bf08" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Lock "cinder-quobyte-561481a6-338e-4a51-91b0-3c3288f4bf08" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:36 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc4a79f-ffdd-4b30-8d3f-c3b2accb5ee4]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:08:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:36 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.462s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:36 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:08:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Deleted volume successfully.
Nov 02 10:08:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e7ed8e2a-73a7-40cc-94a0-2d1c8e26cb12 tempest-ServerActionsTestOtherA-2119603493 None] Lock "cinder-e1945130-875a-4b2a-bede-5b1fb3718f04-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:36 devstack sudo[95072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08
Nov 02 10:08:36 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:36 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08" returned: 0 in 0.443s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:36 devstack sudo[95077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08
Nov 02 10:08:36 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:37 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-561481a6-338e-4a51-91b0-3c3288f4bf08" returned: 0 in 0.387s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Lock "cinder-quobyte-561481a6-338e-4a51-91b0-3c3288f4bf08" released by "delete_volume" :: held 0.908s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:37 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Created reservations ['c57bdfa7-dc38-48f3-8974-7a729af442d3', 'a69670ab-ba8a-48e1-a51d-0895fb13c0f7', '939421c5-64df-43f6-b26f-a16d49d37a51', 'f5016fd1-e4ed-4645-86ec-39429f07bb30'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:08:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:37 devstack sudo[95087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:08:37 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:38 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.656s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:38 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:08:38 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Deleted volume successfully.
Nov 02 10:08:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2416c82-8cb1-4b43-8104-2f3fafb6cae0 tempest-VolumeQuotasNegativeTestJSON-1744600512 None] Lock "cinder-561481a6-338e-4a51-91b0-3c3288f4bf08-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:45 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=70,cinder:UPDATE=82,cinder:DELETE=8,cinder:INSERT=24 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:08:45 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-290ff4e6-9a79-438f-99a6-97426a78a8dc tempest-GroupsV320Test-486750829 None] Group tempest-GroupsV320Test-Group-861103215: creating
Nov 02 10:08:46 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-290ff4e6-9a79-438f-99a6-97426a78a8dc tempest-GroupsV320Test-486750829 None] Group tempest-GroupsV320Test-Group-861103215: created successfully
Nov 02 10:08:46 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-290ff4e6-9a79-438f-99a6-97426a78a8dc tempest-GroupsV320Test-486750829 None] Create group completed successfully.
Nov 02 10:08:48 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-dab76bc0-7d33-4a7f-853a-2bbe50235f77 tempest-GroupsV320Test-486750829 None] Created reservations ['83349fa9-01e3-4d3a-bd73-d8f595e4bcd6'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:08:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dab76bc0-7d33-4a7f-853a-2bbe50235f77 tempest-GroupsV320Test-486750829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dab76bc0-7d33-4a7f-853a-2bbe50235f77 tempest-GroupsV320Test-486750829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dab76bc0-7d33-4a7f-853a-2bbe50235f77 tempest-GroupsV320Test-486750829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dab76bc0-7d33-4a7f-853a-2bbe50235f77 tempest-GroupsV320Test-486750829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dab76bc0-7d33-4a7f-853a-2bbe50235f77 tempest-GroupsV320Test-486750829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dab76bc0-7d33-4a7f-853a-2bbe50235f77 tempest-GroupsV320Test-486750829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:48 devstack sudo[95155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:08:48 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:48 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dab76bc0-7d33-4a7f-853a-2bbe50235f77 tempest-GroupsV320Test-486750829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.450s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:48 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-dab76bc0-7d33-4a7f-853a-2bbe50235f77 tempest-GroupsV320Test-486750829 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:08:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-dab76bc0-7d33-4a7f-853a-2bbe50235f77 tempest-GroupsV320Test-486750829 None] Delete group completed successfully.
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Flow 'volume_create_manager' (b56e98c1-e823-4805-919c-e4ab4e29f877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cfe0bb-8627-459b-936b-7f27d1b78c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cfe0bb-8627-459b-936b-7f27d1b78c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-391828940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9e0fad-27d9-495b-94ea-35104f07917d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba0ba0750a64891bde13d9b6bb757c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:51Z,use_quota=True,user_id='728f337c0fcd4ac3a96dc2068476b88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a774360a-91aa-4e95-9464-7701f65f786c),volume_type_id=a774360a-91aa-4e95-9464-7701f65f786c)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09666d59-267a-411f-9bb8-70945de7e7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09666d59-267a-411f-9bb8-70945de7e7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd03322-ff7c-434d-a671-ffa5d3f370f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd03322-ff7c-434d-a671-ffa5d3f370f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f9e0fad-27d9-495b-94ea-35104f07917d', 'volume_name': 'volume-0f9e0fad-27d9-495b-94ea-35104f07917d', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668d16e7-8941-47a5-8f93-be98b14562b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668d16e7-8941-47a5-8f93-be98b14562b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d4a4f3-edb7-44c2-b7e3-e4ac1328477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:50 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Volume 0f9e0fad-27d9-495b-94ea-35104f07917d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f9e0fad-27d9-495b-94ea-35104f07917d', 'volume_size': 1}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-391828940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9e0fad-27d9-495b-94ea-35104f07917d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba0ba0750a64891bde13d9b6bb757c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:51Z,use_quota=True,user_id='728f337c0fcd4ac3a96dc2068476b88a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a774360a-91aa-4e95-9464-7701f65f786c),volume_type_id=a774360a-91aa-4e95-9464-7701f65f786c)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Creating volume 0f9e0fad-27d9-495b-94ea-35104f07917d {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:08:50 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:08:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:50 devstack sudo[95158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d 1073741824
Nov 02 10:08:50 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:51 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d 1073741824" returned: 0 in 0.729s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:51 devstack sudo[95165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d
Nov 02 10:08:51 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:52 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d" returned: 0 in 0.430s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:08:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d4a4f3-edb7-44c2-b7e3-e4ac1328477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9e0fad-27d9-495b-94ea-35104f07917d', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55f2618-39c7-4c87-9e8b-b91803497198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:52 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Volume volume-0f9e0fad-27d9-495b-94ea-35104f07917d (0f9e0fad-27d9-495b-94ea-35104f07917d): created successfully
Nov 02 10:08:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55f2618-39c7-4c87-9e8b-b91803497198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Flow 'volume_create_manager' (b56e98c1-e823-4805-919c-e4ab4e29f877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:08:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d6cc157a-3128-4123-b18f-724c4ae72961 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Created volume successfully.
Nov 02 10:08:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-05be798a-6b88-4cf3-b71b-7d11ec66c936 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-05be798a-6b88-4cf3-b71b-7d11ec66c936 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-05be798a-6b88-4cf3-b71b-7d11ec66c936 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-05be798a-6b88-4cf3-b71b-7d11ec66c936 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-05be798a-6b88-4cf3-b71b-7d11ec66c936 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-05be798a-6b88-4cf3-b71b-7d11ec66c936 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:53 devstack sudo[95168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:08:53 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:53 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-05be798a-6b88-4cf3-b71b-7d11ec66c936 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.374s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:53 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-05be798a-6b88-4cf3-b71b-7d11ec66c936 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:08:53 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-05be798a-6b88-4cf3-b71b-7d11ec66c936 tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Retype volume completed successfully.
Nov 02 10:08:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Acquiring lock "cinder-0f9e0fad-27d9-495b-94ea-35104f07917d-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "cinder-0f9e0fad-27d9-495b-94ea-35104f07917d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Acquiring lock "cinder-quobyte-0f9e0fad-27d9-495b-94ea-35104f07917d" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:08:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "cinder-quobyte-0f9e0fad-27d9-495b-94ea-35104f07917d" acquired by "delete_volume" :: waited 0.037s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:08:55 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c9b365-806d-444e-a2f1-afd7d76e97b9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:08:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:55 devstack sudo[95171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d
Nov 02 10:08:55 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:55 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d" returned: 0 in 0.549s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:55 devstack sudo[95207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d
Nov 02 10:08:55 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:56 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0f9e0fad-27d9-495b-94ea-35104f07917d" returned: 0 in 0.407s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "cinder-quobyte-0f9e0fad-27d9-495b-94ea-35104f07917d" released by "delete_volume" :: held 1.033s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:56 devstack cinder-volume[87014]: WARNING cinder.quota [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:08:56 devstack cinder-volume[87014]: WARNING cinder.quota [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Flow 'volume_create_manager' (82e33531-938d-49d4-b4f1-4d575264d07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6cdf6a-4b29-4ab4-a8db-917058a5d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Created reservations ['8a3f3af0-0e89-4be9-bece-a0737a3b6536', 'a2b7c3dd-396f-4899-8f35-5719142703f5', '31b59de4-ff0c-43bf-acea-b14c76eadb37', '47a7cb8b-8372-4a8b-a968-e76671ecd40b'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6cdf6a-4b29-4ab4-a8db-917058a5d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-234201572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b8606fd8764b349001865f33b2527b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:56Z,use_quota=True,user_id='4d1039e0fca2499ebc8fa7877dda44e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b4375e-6f6d-4833-943f-a89402c99806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b4375e-6f6d-4833-943f-a89402c99806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfd5c7c-1400-48c2-8e3a-e8d0c5c2fb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bfd5c7c-1400-48c2-8e3a-e8d0c5c2fb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f', 'volume_name': 'volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ca3177-783b-46d8-8fdb-514980d613d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ca3177-783b-46d8-8fdb-514980d613d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380640ac-4de1-4319-a6ea-9adde089c66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:56 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Volume 5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f', 'volume_size': 1}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-234201572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b8606fd8764b349001865f33b2527b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:08:56Z,use_quota=True,user_id='4d1039e0fca2499ebc8fa7877dda44e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Creating volume 5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:08:56 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:56 devstack sudo[95210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f 1073741824
Nov 02 10:08:56 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:56 devstack sudo[95212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:08:56 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:56 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.300s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:56 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:08:56 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Deleted volume successfully.
Nov 02 10:08:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4fa950c0-3a28-4c04-abe2-5c33a8db439f tempest-VolumeRetypeWithoutMigrationTest-2117049776 None] Lock "cinder-0f9e0fad-27d9-495b-94ea-35104f07917d-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:08:57 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f 1073741824" returned: 0 in 0.608s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:57 devstack sudo[95219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f
Nov 02 10:08:57 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:57 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f" returned: 0 in 0.279s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:08:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:08:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380640ac-4de1-4319-a6ea-9adde089c66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d19bcf-2b64-4a80-b612-025f8a90f227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:08:57 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Volume volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f (5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f): created successfully
Nov 02 10:08:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d19bcf-2b64-4a80-b612-025f8a90f227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:08:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Flow 'volume_create_manager' (82e33531-938d-49d4-b4f1-4d575264d07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:08:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-17ef5f22-55d4-4c67-a53a-2c02a5a5be80 req-d5964327-4ce0-478a-aaa3-777c3bfa73dd tempest-VolumesSnapshotsTestJSON-283973009 None] Created volume successfully.
Nov 02 10:08:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:08:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:08:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] Creating offline snapshot 41716fc7-ea1c-4fd6-9cf9-ec031526780e of volume 5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:08:59 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[722a2233-2a08-4943-9d0b-18a1d70f954d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:08:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:59 devstack sudo[95223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f
Nov 02 10:08:59 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:08:59 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root
Nov 02 10:08:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f" returned: 0 in 0.578s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:08:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:08:59 devstack sudo[95228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e 1G
Nov 02 10:08:59 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:00 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e 1G" returned: 0 in 0.573s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:00 devstack sudo[95234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e
Nov 02 10:09:00 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:00 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e" returned: 0 in 0.335s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:00 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e is being set with open permissions: ugo+rw
Nov 02 10:09:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:00 devstack sudo[95239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e
Nov 02 10:09:00 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:00 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e" returned: 0 in 0.365s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:01 devstack sudo[95242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.info
Nov 02 10:09:01 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:01 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.info" returned: 0 in 0.293s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:01 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.info is being set with open permissions: ugo+rw
Nov 02 10:09:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:01 devstack sudo[95246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.info
Nov 02 10:09:01 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:01 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.info" returned: 0 in 0.314s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.578s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-36698cd1-f573-4a47-a4cd-eb975979e234 req-b07dc003-8eed-43be-91c1-4fe98d9ba2f9 tempest-VolumesSnapshotsTestJSON-283973009 None] Create snapshot completed successfully
Nov 02 10:09:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Acquiring lock "cinder-41716fc7-ea1c-4fd6-9cf9-ec031526780e-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "cinder-41716fc7-ea1c-4fd6-9cf9-ec031526780e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Acquiring lock "cinder-quobyte-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "cinder-quobyte-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Acquiring lock "cinder-quobyte-41716fc7-ea1c-4fd6-9cf9-ec031526780e" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "cinder-quobyte-41716fc7-ea1c-4fd6-9cf9-ec031526780e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Deleting offline snapshot 41716fc7-ea1c-4fd6-9cf9-ec031526780e of volume 5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:09:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] snapshot_file for this snap is: volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:09:02 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[41370e5f-0eef-4b6e-b802-ddfebe5077d3]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:02 devstack sudo[95249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e
Nov 02 10:09:02 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:02 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e" returned: 0 in 0.467s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:02 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2a0f40-8cb2-443f-9d6c-a57afae79524]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:02 devstack sudo[95254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f
Nov 02 10:09:02 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:03 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f" returned: 0 in 0.512s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:03 devstack sudo[95259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e
Nov 02 10:09:03 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:03 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e" returned: 0 in 0.586s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:03 devstack sudo[95264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e
Nov 02 10:09:03 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:04 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f.41716fc7-ea1c-4fd6-9cf9-ec031526780e" returned: 0 in 0.513s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "cinder-quobyte-41716fc7-ea1c-4fd6-9cf9-ec031526780e" released by "_delete_snapshot" :: held 2.260s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "cinder-quobyte-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f" released by "delete_snapshot" :: held 2.294s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:04 devstack cinder-volume[87014]: WARNING cinder.quota [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:09:04 devstack cinder-volume[87014]: DEBUG cinder.quota [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Created reservations ['8538a295-c937-43ee-a056-54211366643c', 'd8973ed1-b986-40a7-885d-d18b3137ce57', '3a01e3e3-adf8-497d-93c7-1cffae05a397', 'ba2fe66d-46f3-44b8-8674-0da5cb2f6bce'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:04 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Delete snapshot completed successfully.
Nov 02 10:09:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-126ef81a-eff2-4481-830d-2cca05b9b1a3 req-095c2805-af77-456e-9cdd-75b3d2007f99 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "cinder-41716fc7-ea1c-4fd6-9cf9-ec031526780e-delete_snapshot" released by "delete_snapshot" :: held 2.531s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Acquiring lock "cinder-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "cinder-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Acquiring lock "cinder-quobyte-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "cinder-quobyte-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f254b3-62c4-42eb-8029-9b2269f60f50]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:05 devstack sudo[95269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f
Nov 02 10:09:05 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:05 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f" returned: 0 in 0.450s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:06 devstack sudo[95274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f
Nov 02 10:09:06 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:06 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f" returned: 0 in 0.309s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "cinder-quobyte-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f" released by "delete_volume" :: held 0.858s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.quota [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Created reservations ['8678ff14-b7e1-4e0d-afa1-33950fddc53e', '4bd18972-4c7d-43c1-a25c-a9fc54e5c9d3', 'c7ee8731-02d4-4152-8b07-9a9b3d9bed87', '23e571c9-2334-403c-8cb7-7d6b4c10d65d'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Flow 'volume_create_manager' (cdfad663-e8f0-4e07-ad58-e1c26c3ccda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67da924b-e2dd-43e9-9e71-ca0e3eb9dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67da924b-e2dd-43e9-9e71-ca0e3eb9dd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1203564866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32df8edc-64a3-4326-99a3-dfcb6dedaca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff22b829e6d64af2be58870c551a186b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:06Z,use_quota=True,user_id='e172074b448249e798c7852a9061d581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95fd905-ae03-4b0e-bc51-472e85f36884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95fd905-ae03-4b0e-bc51-472e85f36884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87f6db9-46f5-4737-bbc5-0d4183896537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87f6db9-46f5-4737-bbc5-0d4183896537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32df8edc-64a3-4326-99a3-dfcb6dedaca3', 'volume_name': 'volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b947f4c4-426d-49bf-95fb-cd1d7d30eb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b947f4c4-426d-49bf-95fb-cd1d7d30eb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466cc696-350f-439e-bf81-db10ff1e6a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:06 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Volume 32df8edc-64a3-4326-99a3-dfcb6dedaca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3', 'volume_size': 1}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1203564866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32df8edc-64a3-4326-99a3-dfcb6dedaca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff22b829e6d64af2be58870c551a186b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:06Z,use_quota=True,user_id='e172074b448249e798c7852a9061d581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Creating volume 32df8edc-64a3-4326-99a3-dfcb6dedaca3 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:09:06 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:06 devstack sudo[95277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3 1073741824
Nov 02 10:09:06 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:06 devstack sudo[95279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:09:06 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:07 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.368s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG cinder.manager [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:09:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Deleted volume successfully.
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-aab5d085-740c-4bec-9c55-5c848194f112 req-98c4dc11-3d2d-43b2-aa71-42d16e700316 tempest-VolumesSnapshotsTestJSON-283973009 None] Lock "cinder-5d1d11e0-0f96-4b0a-a5ff-f58e6c60654f-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:07 devstack sudo[95320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:09:07 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:07 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3 1073741824" returned: 0 in 0.681s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:07 devstack sudo[95324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3
Nov 02 10:09:07 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:07 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.412s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:09:07 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3" returned: 0 in 0.565s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (466cc696-350f-439e-bf81-db10ff1e6a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edeed8fe-1101-4766-a27f-027d6b84c6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:07 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Volume volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3 (32df8edc-64a3-4326-99a3-dfcb6dedaca3): created successfully
Nov 02 10:09:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edeed8fe-1101-4766-a27f-027d6b84c6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Flow 'volume_create_manager' (cdfad663-e8f0-4e07-ad58-e1c26c3ccda9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:08 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-75dd4347-f4c3-492a-adeb-b0b8b470ca2b tempest-VolumesServicesTestJSON-1482527701 None] Created volume successfully.
Nov 02 10:09:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Acquiring lock "cinder-32df8edc-64a3-4326-99a3-dfcb6dedaca3-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Lock "cinder-32df8edc-64a3-4326-99a3-dfcb6dedaca3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Acquiring lock "cinder-quobyte-32df8edc-64a3-4326-99a3-dfcb6dedaca3" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Lock "cinder-quobyte-32df8edc-64a3-4326-99a3-dfcb6dedaca3" acquired by "delete_volume" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd4733a-97ca-4bc3-a898-3d79a91d4812]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:09 devstack sudo[95357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3
Nov 02 10:09:09 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Flow 'volume_create_manager' (c58250a1-2f99-4ebc-a0cb-dcc71ccff968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6b870c-83cd-4e5e-89f7-2aba5d850f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6b870c-83cd-4e5e-89f7-2aba5d850f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1467017112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69f833e-bd7c-4054-ba3a-e3cec6f91da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db8d80ca7c54dd29dd33ded3c4c131c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:09Z,use_quota=True,user_id='919d8b3a2e2a40ecab56eace1e17bbbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca94695-1f0e-4915-8deb-5186d44d0c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca94695-1f0e-4915-8deb-5186d44d0c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ce9343-724e-4a41-b3bc-0e931a69f2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ce9343-724e-4a41-b3bc-0e931a69f2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69f833e-bd7c-4054-ba3a-e3cec6f91da7', 'volume_name': 'volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113d3f95-6812-4b92-9567-081ad43961e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113d3f95-6812-4b92-9567-081ad43961e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55f2e76-54d0-4efa-92ed-90b4534fedc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:09 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7', 'volume_size': 1}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1467017112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69f833e-bd7c-4054-ba3a-e3cec6f91da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db8d80ca7c54dd29dd33ded3c4c131c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:09Z,use_quota=True,user_id='919d8b3a2e2a40ecab56eace1e17bbbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Creating volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:09:09 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:09 devstack sudo[95359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 1073741824
Nov 02 10:09:09 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:09 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3" returned: 0 in 0.515s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:09 devstack sudo[95365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3
Nov 02 10:09:09 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:10 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-32df8edc-64a3-4326-99a3-dfcb6dedaca3" returned: 0 in 0.356s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Lock "cinder-quobyte-32df8edc-64a3-4326-99a3-dfcb6dedaca3" released by "delete_volume" :: held 0.956s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Created reservations ['adbeabc3-b150-4594-b393-ea59e86cc700', 'ec33ab8e-01d9-4389-b722-c96e639f36dd', '93b71d59-b457-4fa5-9fa7-3b21e92fad16', '58c6006b-01cd-49ab-8dc8-668d26d414dc'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:10 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 1073741824" returned: 0 in 0.721s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:10 devstack sudo[95375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:09:10 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:10 devstack sudo[95377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7
Nov 02 10:09:10 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:10 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.353s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:09:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Deleted volume successfully.
Nov 02 10:09:10 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" returned: 0 in 0.318s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-059089cf-f167-44dc-8b20-073a68845ef8 tempest-VolumesServicesTestJSON-1482527701 None] Lock "cinder-32df8edc-64a3-4326-99a3-dfcb6dedaca3-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55f2e76-54d0-4efa-92ed-90b4534fedc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfc8132-e7cb-4a11-9291-0f890d4f1df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:10 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Volume volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 (f69f833e-bd7c-4054-ba3a-e3cec6f91da7): created successfully
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfc8132-e7cb-4a11-9291-0f890d4f1df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Flow 'volume_create_manager' (c58250a1-2f99-4ebc-a0cb-dcc71ccff968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-52349e26-2684-43bc-8317-430a756bed73 tempest-SnapshotsActionsTest-1541338786 None] Created volume successfully.
Nov 02 10:09:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] Creating offline snapshot 2aa6bf9d-55a5-423f-b18f-1d0f0c05053b of volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:09:11 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb811434-781e-4d9d-8935-cd924ba74621]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:12 devstack sudo[95382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7
Nov 02 10:09:12 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:12 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" returned: 0 in 0.469s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:12 devstack sudo[95388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b 1G
Nov 02 10:09:12 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:13 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b 1G" returned: 0 in 0.589s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:13 devstack sudo[95394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:13 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:13 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.452s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:13 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b is being set with open permissions: ugo+rw
Nov 02 10:09:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:13 devstack sudo[95400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:13 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:13 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.477s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:14 devstack sudo[95403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.info
Nov 02 10:09:14 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Flow 'volume_create_manager' (38b3d286-1f77-44fd-a2ea-f36edef3f888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8dbe60-e6b5-45e3-bfb1-44a6af07bef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8dbe60-e6b5-45e3-bfb1-44a6af07bef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1195676101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222c774a-4a3d-4c65-b153-470e50a5db04,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35e4d679e91148dc9b8b1bc4569ac033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:14Z,use_quota=True,user_id='91f44549de8f4cc0bda41d8a46d27d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cf1c7b-aaec-4659-b911-e368136288a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cf1c7b-aaec-4659-b911-e368136288a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bcb686-0d0f-487c-b0ed-8986243699c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bcb686-0d0f-487c-b0ed-8986243699c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222c774a-4a3d-4c65-b153-470e50a5db04', 'volume_name': 'volume-222c774a-4a3d-4c65-b153-470e50a5db04', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c2ad0c-7d19-4198-9847-2bf26e95df1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c2ad0c-7d19-4198-9847-2bf26e95df1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd596a53-d0df-4157-a0ac-4933182a2ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:14 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Volume 222c774a-4a3d-4c65-b153-470e50a5db04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222c774a-4a3d-4c65-b153-470e50a5db04', 'volume_size': 1}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:14 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.info" returned: 0 in 0.393s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:14 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.info is being set with open permissions: ugo+rw
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:14 devstack sudo[95406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.info
Nov 02 10:09:14 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:14 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.info" returned: 0 in 0.314s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.550s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1195676101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222c774a-4a3d-4c65-b153-470e50a5db04,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35e4d679e91148dc9b8b1bc4569ac033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:14Z,use_quota=True,user_id='91f44549de8f4cc0bda41d8a46d27d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Creating volume 222c774a-4a3d-4c65-b153-470e50a5db04 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:09:14 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:09:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:14 devstack sudo[95410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04 1073741824
Nov 02 10:09:14 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:14 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0adb586f-2644-43bc-b115-00a14a9fe3f2 tempest-SnapshotsActionsTest-1541338786 None] Create snapshot completed successfully
Nov 02 10:09:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-b7e4d330-03e2-4a7f-8ace-fa8da863f7a3 req-facad9dd-a452-4495-9ae9-a243c93f12b7 tempest-AttachVolumeNegativeTest-1334827169 None] Terminate volume connection completed successfully.
Nov 02 10:09:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-b7e4d330-03e2-4a7f-8ace-fa8da863f7a3 req-facad9dd-a452-4495-9ae9-a243c93f12b7 tempest-AttachVolumeNegativeTest-1334827169 None] Deleting attachment 05026c98-69ae-4af4-b768-aab76fc79389. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:09:15 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04 1073741824" returned: 0 in 0.623s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:15 devstack sudo[95418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04
Nov 02 10:09:15 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:15 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04" returned: 0 in 0.389s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:09:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd596a53-d0df-4157-a0ac-4933182a2ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222c774a-4a3d-4c65-b153-470e50a5db04', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de92bc92-144b-4ee7-b9fa-1a55c4bcd9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:15 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Volume volume-222c774a-4a3d-4c65-b153-470e50a5db04 (222c774a-4a3d-4c65-b153-470e50a5db04): created successfully
Nov 02 10:09:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de92bc92-144b-4ee7-b9fa-1a55c4bcd9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Flow 'volume_create_manager' (38b3d286-1f77-44fd-a2ea-f36edef3f888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-563f9b6e-e0a3-40dc-9a31-5b0b932e6bc9 req-8144b426-9dbd-4000-83e2-f16bb2deb5e1 tempest-VolumesGetTestJSON-627429629 None] Created volume successfully.
Nov 02 10:09:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:16 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=111,cinder:UPDATE=113,cinder:DELETE=9,cinder:INSERT=17 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:09:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] Creating offline snapshot 369f5a1b-c5b1-48cd-bba5-69681a6a4291 of volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:09:16 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[841939f5-726b-41cf-9e5b-10cfbac0b0de]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:17 devstack sudo[95436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:17 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Acquiring lock "cinder-222c774a-4a3d-4c65-b153-470e50a5db04-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Lock "cinder-222c774a-4a3d-4c65-b153-470e50a5db04-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Acquiring lock "cinder-quobyte-222c774a-4a3d-4c65-b153-470e50a5db04" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Lock "cinder-quobyte-222c774a-4a3d-4c65-b153-470e50a5db04" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:17 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a1805c-00f3-442d-9479-81e2c90c3eab]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:17 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.879s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:17 devstack sudo[95451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291 1G
Nov 02 10:09:17 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:17 devstack sudo[95450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04
Nov 02 10:09:17 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:18 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04" returned: 0 in 0.620s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:18 devstack sudo[95462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04
Nov 02 10:09:18 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:18 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291 1G" returned: 0 in 0.849s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:18 devstack sudo[95466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291
Nov 02 10:09:18 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:18 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-222c774a-4a3d-4c65-b153-470e50a5db04" returned: 0 in 0.552s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Lock "cinder-quobyte-222c774a-4a3d-4c65-b153-470e50a5db04" released by "delete_volume" :: held 1.245s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:18 devstack cinder-volume[87014]: DEBUG cinder.quota [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Created reservations ['95fbaa3f-d2af-4bda-a837-cc52c756d4e2', '22a096c9-c13c-4ea3-a1b0-a1178d5f8dc8', 'ec3457a6-c7cb-4eb9-a4cb-9d1b47653e90', '825df75c-a424-4b11-b6db-62f22dcff726'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:19 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291" returned: 0 in 0.467s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:19 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291 is being set with open permissions: ugo+rw
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:19 devstack sudo[95473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291
Nov 02 10:09:19 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:19 devstack sudo[95476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:09:19 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:19 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291" returned: 0 in 0.426s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.940s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:19 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.386s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG cinder.manager [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:09:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Deleted volume successfully.
Nov 02 10:09:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5e63f521-4612-4d36-a1e1-d0d0ee25c573 tempest-SnapshotsActionsTest-1541338786 None] Create snapshot completed successfully
Nov 02 10:09:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-69d09677-952a-4642-8a8d-d3a9cb2d5640 req-5e959e2a-61fd-48c3-a5b3-f7b6525fbffa tempest-VolumesGetTestJSON-627429629 None] Lock "cinder-222c774a-4a3d-4c65-b153-470e50a5db04-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-369f5a1b-c5b1-48cd-bba5-69681a6a4291-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-369f5a1b-c5b1-48cd-bba5-69681a6a4291-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-quobyte-369f5a1b-c5b1-48cd-bba5-69681a6a4291" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-369f5a1b-c5b1-48cd-bba5-69681a6a4291" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Deleting offline snapshot 369f5a1b-c5b1-48cd-bba5-69681a6a4291 of volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] snapshot_file for this snap is: volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e89c9ac-bc3d-40b4-892e-52f7388d7dff]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:20 devstack sudo[95480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291
Nov 02 10:09:20 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:20 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291" returned: 0 in 0.474s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7569adfc-a806-4dbc-891c-d329fae82337]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:20 devstack sudo[95485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:20 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:21 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.530s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:21 devstack sudo[95490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291
Nov 02 10:09:21 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:21 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291" returned: 0 in 0.524s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:21 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291
Nov 02 10:09:21 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:22 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.369f5a1b-c5b1-48cd-bba5-69681a6a4291" returned: 0 in 0.445s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-369f5a1b-c5b1-48cd-bba5-69681a6a4291" released by "_delete_snapshot" :: held 2.129s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" released by "delete_snapshot" :: held 2.165s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Created reservations ['88e65a45-0f2e-4b34-997a-8f17bacf9d35', 'd6c14b28-c7ff-47d7-b040-ea242913ed27', '0dd87baa-66f4-4c12-8e04-214e2313861c', '83956fb0-5c30-474f-a9fb-e91bb93736fe'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Delete snapshot completed successfully.
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4bd73e8c-c885-4d59-ae4e-ec6b9fc20554 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-369f5a1b-c5b1-48cd-bba5-69681a6a4291-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Flow 'volume_create_manager' (c210dc4f-f8a6-4b2c-9b9d-aad3e9c7d59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd1e79a-90a1-429a-8044-defceeb82fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd1e79a-90a1-429a-8044-defceeb82fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-53280446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0f9b8a-ebf9-4198-9298-503c933fbba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb60177de9394ecf8f7dc04012d6a7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:22Z,use_quota=True,user_id='8c5f02cb115243b2b2aa1a683d23be2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb27b7de-4b0e-43c8-9144-4575c8323313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb27b7de-4b0e-43c8-9144-4575c8323313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbcaba0-ac99-4452-902d-a8acc2f1cfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbcaba0-ac99-4452-902d-a8acc2f1cfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f0f9b8a-ebf9-4198-9298-503c933fbba6', 'volume_name': 'volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a3e2a9-5d41-406f-bc48-a357476b88e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a3e2a9-5d41-406f-bc48-a357476b88e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4402bf8-c630-4424-a8db-ed56ec3a00ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:22 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Volume 4f0f9b8a-ebf9-4198-9298-503c933fbba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6', 'volume_size': 1}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-53280446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0f9b8a-ebf9-4198-9298-503c933fbba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb60177de9394ecf8f7dc04012d6a7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:22Z,use_quota=True,user_id='8c5f02cb115243b2b2aa1a683d23be2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Creating volume 4f0f9b8a-ebf9-4198-9298-503c933fbba6 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:09:22 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:09:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:22 devstack sudo[95499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 1073741824
Nov 02 10:09:22 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:23 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 1073741824" returned: 0 in 0.547s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:23 devstack sudo[95505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6
Nov 02 10:09:23 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:23 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6" returned: 0 in 0.345s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4402bf8-c630-4424-a8db-ed56ec3a00ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7972971-71b5-4d3c-bd04-19193d28114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:23 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Volume volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 (4f0f9b8a-ebf9-4198-9298-503c933fbba6): created successfully
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7972971-71b5-4d3c-bd04-19193d28114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Flow 'volume_create_manager' (c210dc4f-f8a6-4b2c-9b9d-aad3e9c7d59d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:23 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-aa93505c-4b22-4174-a529-9eeb9b9cc478 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Created volume successfully.
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] Creating offline snapshot 7a792888-b34f-4b7d-8f07-80c29bb66e11 of volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df53d1a-c010-4c77-966f-3fb9cf48873c]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:23 devstack sudo[95508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:23 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:24 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.445s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:24 devstack sudo[95513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11 1G
Nov 02 10:09:24 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:24 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11 1G" returned: 0 in 0.672s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:24 devstack sudo[95519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11
Nov 02 10:09:24 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:25 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11" returned: 0 in 0.369s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:25 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11 is being set with open permissions: ugo+rw
Nov 02 10:09:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:25 devstack sudo[95525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11
Nov 02 10:09:25 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:25 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11" returned: 0 in 0.276s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.651s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Creating offline snapshot f1a83010-e2c0-4546-ab8c-cffac2f06f29 of volume 4f0f9b8a-ebf9-4198-9298-503c933fbba6 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:09:25 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-92f7e552-23d9-4311-a07c-d6721ee957b4 tempest-SnapshotsActionsTest-1541338786 None] Create snapshot completed successfully
Nov 02 10:09:25 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c990be6-0873-467a-8cce-ab0191ea00b7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:25 devstack sudo[95528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6
Nov 02 10:09:25 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:26 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-657ac2ed-dbcb-409b-8d51-b9de464a89b2 tempest-GroupSnapshotsTest-262746101 None] Group tempest-GroupSnapshotsTest-Group-1054144596: creating
Nov 02 10:09:26 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-657ac2ed-dbcb-409b-8d51-b9de464a89b2 tempest-GroupSnapshotsTest-262746101 None] Group tempest-GroupSnapshotsTest-Group-1054144596: created successfully
Nov 02 10:09:26 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-657ac2ed-dbcb-409b-8d51-b9de464a89b2 tempest-GroupSnapshotsTest-262746101 None] Create group completed successfully.
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-7a792888-b34f-4b7d-8f07-80c29bb66e11-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-7a792888-b34f-4b7d-8f07-80c29bb66e11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-quobyte-7a792888-b34f-4b7d-8f07-80c29bb66e11" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-7a792888-b34f-4b7d-8f07-80c29bb66e11" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Deleting offline snapshot 7a792888-b34f-4b7d-8f07-80c29bb66e11 of volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] snapshot_file for this snap is: volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea21a00-3a1b-4857-ab2b-96ba27807c34]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:26 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6" returned: 0 in 0.524s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:26 devstack sudo[95534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29 1G
Nov 02 10:09:26 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:26 devstack sudo[95533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11
Nov 02 10:09:26 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:26 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11" returned: 0 in 0.395s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[35253fd0-a47b-49fb-a8e3-167477ab5963]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:26 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29 1G" returned: 0 in 0.498s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:26 devstack sudo[95548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29
Nov 02 10:09:26 devstack sudo[95544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:26 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:26 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:27 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29" returned: 0 in 0.358s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:27 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29 is being set with open permissions: ugo+rw
Nov 02 10:09:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:27 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.479s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:27 devstack sudo[95559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29
Nov 02 10:09:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:27 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:27 devstack sudo[95561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11
Nov 02 10:09:27 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:27 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29" returned: 0 in 0.316s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:27 devstack sudo[95567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.info
Nov 02 10:09:27 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:27 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11" returned: 0 in 0.567s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:27 devstack sudo[95570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11
Nov 02 10:09:27 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:27 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.info" returned: 0 in 0.386s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:27 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.info is being set with open permissions: ugo+rw
Nov 02 10:09:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:27 devstack sudo[95573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.info
Nov 02 10:09:27 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Flow 'volume_create_manager' (025b468a-26b4-4ac1-a719-2e41e4bb7382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:28 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79094e55-e3f0-454a-b22f-d8bf0f3d2014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.7a792888-b34f-4b7d-8f07-80c29bb66e11" returned: 0 in 0.442s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79094e55-e3f0-454a-b22f-d8bf0f3d2014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2135141398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=45217c15-4728-4e4a-9c58-e108e97ff502,host='devstack@QuobyteHD#QuobyteHD',id=0e24d05f-f3f0-46b6-aa39-019c02718dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5d133ecd09439785a63d6d87670e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:28Z,use_quota=True,user_id='e3c13430ae1a4b00af80511eb576879f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3350a2-d085-481a-a90c-e044dd823934),volume_type_id=fd3350a2-d085-481a-a90c-e044dd823934)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cb40ed-8f9c-441d-be11-7f0df36957d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cb40ed-8f9c-441d-be11-7f0df36957d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:28 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa0355a-7c95-4e63-b2f7-781310f439c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa0355a-7c95-4e63-b2f7-781310f439c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e24d05f-f3f0-46b6-aa39-019c02718dcf', 'volume_name': 'volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15020f44-da43-4414-b8ec-5f6d0c4e674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15020f44-da43-4414-b8ec-5f6d0c4e674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df98913-de30-4c31-9c89-a72e5188e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:28 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Volume 0e24d05f-f3f0-46b6-aa39-019c02718dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf', 'volume_size': 1}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-7a792888-b34f-4b7d-8f07-80c29bb66e11" released by "_delete_snapshot" :: held 2.063s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.info" returned: 0 in 0.382s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.614s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" released by "delete_snapshot" :: held 2.120s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.045s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=45217c15-4728-4e4a-9c58-e108e97ff502,created_at=2026-11-02T09:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2135141398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=45217c15-4728-4e4a-9c58-e108e97ff502,host='devstack@QuobyteHD#QuobyteHD',id=0e24d05f-f3f0-46b6-aa39-019c02718dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5d133ecd09439785a63d6d87670e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:28Z,use_quota=True,user_id='e3c13430ae1a4b00af80511eb576879f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd3350a2-d085-481a-a90c-e044dd823934),volume_type_id=fd3350a2-d085-481a-a90c-e044dd823934)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Creating volume 0e24d05f-f3f0-46b6-aa39-019c02718dcf {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:09:28 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:28 devstack sudo[95578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf 1073741824
Nov 02 10:09:28 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:28 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8c47cc86-8ec8-44f2-845b-8ed934711531 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Create snapshot completed successfully
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Created reservations ['f1d6332e-a65b-4bf2-a6c3-b12fa47cc7f0', '7f941d6f-aae7-4fb1-a801-c3d2322c827c', '88ff1264-56a8-4a55-8e01-d1ee85fcaae2', '34af8c8f-32e1-4361-85c9-120fd017c713'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:28 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Delete snapshot completed successfully.
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-22376146-dda7-451c-870d-2de31d7f52b1 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-7a792888-b34f-4b7d-8f07-80c29bb66e11-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:28 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf 1073741824" returned: 0 in 0.565s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:28 devstack sudo[95595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf
Nov 02 10:09:28 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:29 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf" returned: 0 in 0.384s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df98913-de30-4c31-9c89-a72e5188e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f22693-51ec-4f03-9fe6-dcc1f7659ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:29 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Volume volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf (0e24d05f-f3f0-46b6-aa39-019c02718dcf): created successfully
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f22693-51ec-4f03-9fe6-dcc1f7659ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Flow 'volume_create_manager' (025b468a-26b4-4ac1-a719-2e41e4bb7382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:29 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b5159cca-06a7-4b65-a234-7cf2a01b5ed9 tempest-GroupSnapshotsTest-262746101 None] Created volume successfully.
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] Creating offline snapshot b4f6142f-2c47-4d02-8c8c-4870d3c040b2 of volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[072c747a-d518-4c76-91da-aa46ac174f33]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Acquiring lock "cinder-f1a83010-e2c0-4546-ab8c-cffac2f06f29-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:29 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "cinder-f1a83010-e2c0-4546-ab8c-cffac2f06f29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Acquiring lock "cinder-quobyte-4f0f9b8a-ebf9-4198-9298-503c933fbba6" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "cinder-quobyte-4f0f9b8a-ebf9-4198-9298-503c933fbba6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Acquiring lock "cinder-quobyte-f1a83010-e2c0-4546-ab8c-cffac2f06f29" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "cinder-quobyte-f1a83010-e2c0-4546-ab8c-cffac2f06f29" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Deleting offline snapshot f1a83010-e2c0-4546-ab8c-cffac2f06f29 of volume 4f0f9b8a-ebf9-4198-9298-503c933fbba6 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:09:30 devstack sudo[95604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:30 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] snapshot_file for this snap is: volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[412e5505-c667-4deb-9e7f-a6c0040ce295]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:30 devstack sudo[95606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29
Nov 02 10:09:30 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:30 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.425s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:30 devstack sudo[95613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2 1G
Nov 02 10:09:30 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:30 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29" returned: 0 in 0.506s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5ba42e-bcb5-442c-a31f-ca54496058c3]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:30 devstack sudo[95621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6
Nov 02 10:09:30 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:30 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2 1G" returned: 0 in 0.623s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:31 devstack sudo[95623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2
Nov 02 10:09:31 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:31 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] GroupSnapshot 78fb5e82-cc5d-463c-9365-d8f739e50fd0: creating.
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] Group snapshot 78fb5e82-cc5d-463c-9365-d8f739e50fd0: creating. {{(pid=87014) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:31 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6" returned: 0 in 0.515s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:31 devstack sudo[95629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29
Nov 02 10:09:31 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:31 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2" returned: 0 in 0.411s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:31 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2 is being set with open permissions: ugo+rw
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:31 devstack sudo[95636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2
Nov 02 10:09:31 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:31 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29" returned: 0 in 0.393s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:31 devstack sudo[95639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29
Nov 02 10:09:31 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:31 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2" returned: 0 in 0.322s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.754s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] Creating offline snapshot dc6d3641-feba-4433-884e-86fdac8bbdcc of volume 0e24d05f-f3f0-46b6-aa39-019c02718dcf {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:09:31 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d4e07208-9061-49fc-a8d9-bdbe6c469368 tempest-SnapshotsActionsTest-1541338786 None] Create snapshot completed successfully
Nov 02 10:09:32 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ca3969-e22f-4683-83d4-cb6bf7e34d2a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:32 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6.f1a83010-e2c0-4546-ab8c-cffac2f06f29" returned: 0 in 0.573s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "cinder-quobyte-f1a83010-e2c0-4546-ab8c-cffac2f06f29" released by "_delete_snapshot" :: held 2.209s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "cinder-quobyte-4f0f9b8a-ebf9-4198-9298-503c933fbba6" released by "delete_snapshot" :: held 2.255s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:32 devstack sudo[95661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf
Nov 02 10:09:32 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:32 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Created reservations ['ed137694-67cc-44bc-9591-2af694ca9fe4', '333ee351-1701-425e-b2ef-c9cd945d8ff2', 'c6ad60ef-bbad-4999-b628-76250089c08e', '6a8629b3-d76a-4bdc-b3c4-967079b2fd7b'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:32 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Delete snapshot completed successfully.
Nov 02 10:09:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bc2e73a-5b7e-41a5-84fe-7c88a1d5092e tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "cinder-f1a83010-e2c0-4546-ab8c-cffac2f06f29-delete_snapshot" released by "delete_snapshot" :: held 2.619s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:32 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf" returned: 0 in 0.794s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:32 devstack sudo[95710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc 1G
Nov 02 10:09:32 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-b4f6142f-2c47-4d02-8c8c-4870d3c040b2-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-b4f6142f-2c47-4d02-8c8c-4870d3c040b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-quobyte-b4f6142f-2c47-4d02-8c8c-4870d3c040b2" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-b4f6142f-2c47-4d02-8c8c-4870d3c040b2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Deleting offline snapshot b4f6142f-2c47-4d02-8c8c-4870d3c040b2 of volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] snapshot_file for this snap is: volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Acquiring lock "cinder-4f0f9b8a-ebf9-4198-9298-503c933fbba6-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c80c99-89bf-4ab1-91b8-3d65d723a9bf]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "cinder-4f0f9b8a-ebf9-4198-9298-503c933fbba6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Acquiring lock "cinder-quobyte-4f0f9b8a-ebf9-4198-9298-503c933fbba6" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:33 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "cinder-quobyte-4f0f9b8a-ebf9-4198-9298-503c933fbba6" acquired by "delete_volume" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc 1G" returned: 0 in 0.781s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[41484b9c-effa-4a86-bcb1-b5a95b87e9f0]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:33 devstack sudo[95722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc
Nov 02 10:09:33 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:33 devstack sudo[95719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2
Nov 02 10:09:33 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:34 devstack sudo[95723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6
Nov 02 10:09:34 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:34 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2" returned: 0 in 0.766s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde4f89-6d36-408e-9468-8e424b3b304d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:34 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc" returned: 0 in 0.693s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:34 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:34 devstack sudo[95734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc
Nov 02 10:09:34 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:34 devstack sudo[95733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:34 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:34 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6" returned: 0 in 0.840s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:34 devstack sudo[95740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6
Nov 02 10:09:34 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:34 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc" returned: 0 in 0.326s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:34 devstack sudo[95744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.info
Nov 02 10:09:34 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:34 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.589s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:34 devstack sudo[95749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2
Nov 02 10:09:34 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:34 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-4f0f9b8a-ebf9-4198-9298-503c933fbba6" returned: 0 in 0.435s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "cinder-quobyte-4f0f9b8a-ebf9-4198-9298-503c933fbba6" released by "delete_volume" :: held 1.400s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:34 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Created reservations ['492d435a-8729-431b-987d-3f3a38b52648', 'd3657714-3897-4702-9579-d94dec2e796e', 'a389dc6c-d3a5-4e9d-ae21-55386140983a', 'bc7d37a6-15f1-498e-a0c7-22d6a923205b'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:35 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.info" returned: 0 in 0.344s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:35 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:35 devstack sudo[95752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.info
Nov 02 10:09:35 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:35 devstack sudo[95756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:09:35 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:35 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.info" returned: 0 in 0.427s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.591s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:35 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2" returned: 0 in 0.725s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:35 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.449s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:09:35 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Deleted volume successfully.
Nov 02 10:09:35 devstack sudo[95762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2
Nov 02 10:09:35 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:35 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9724799f-b13b-4f8b-996f-09cdb69b8214 tempest-GroupSnapshotsTest-262746101 None] group_snapshot 78fb5e82-cc5d-463c-9365-d8f739e50fd0: created successfully
Nov 02 10:09:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e91f7d6d-4158-4b56-b936-2afdfc2aae78 tempest-VolumeSnapshotQuotasNegativeTestJSON-809729207 None] Lock "cinder-4f0f9b8a-ebf9-4198-9298-503c933fbba6-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:36 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.b4f6142f-2c47-4d02-8c8c-4870d3c040b2" returned: 0 in 0.454s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-b4f6142f-2c47-4d02-8c8c-4870d3c040b2" released by "_delete_snapshot" :: held 2.730s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" released by "delete_snapshot" :: held 2.773s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:36 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Created reservations ['9cd34b3e-74c6-4e24-91e1-d70210e75be4', '1bfdabb8-2b35-4c2a-b498-445588defab3', '08483b90-e05d-462a-afe9-d9bfa25f1398', '6feb4a3d-6d29-4122-abed-bdd111e32a14'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Delete snapshot completed successfully.
Nov 02 10:09:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-42aa7a79-c60c-4c98-933f-0fad21410889 tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-b4f6142f-2c47-4d02-8c8c-4870d3c040b2-delete_snapshot" released by "delete_snapshot" :: held 3.067s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] Creating offline snapshot 2d9913ae-7723-4056-bdcd-6681ce5183dc of volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:09:37 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daae176-0a25-42bf-8848-a17dfca8c751]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:37 devstack sudo[95766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:37 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:37 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.661s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:37 devstack sudo[95772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc 1G
Nov 02 10:09:37 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:38 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc 1G" returned: 0 in 0.746s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:38 devstack sudo[95779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc
Nov 02 10:09:38 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:39 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc" returned: 0 in 0.594s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:39 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc is being set with open permissions: ugo+rw
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:39 devstack sudo[95785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc
Nov 02 10:09:39 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:39 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc" returned: 0 in 0.311s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.995s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-dc6d3641-feba-4433-884e-86fdac8bbdcc-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" by "_create_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-dc6d3641-feba-4433-884e-86fdac8bbdcc-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Creating volume 7ac11f3f-506e-44e5-ab7c-4af9ff3fee25 from snapshot dc6d3641-feba-4433-884e-86fdac8bbdcc {{(pid=87014) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e644e70e-f7ad-4b51-9236-570d15403081 tempest-SnapshotsActionsTest-1541338786 None] Create snapshot completed successfully
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] snapshot: dc6d3641-feba-4433-884e-86fdac8bbdcc, volume: 7ac11f3f-506e-44e5-ab7c-4af9ff3fee25,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c5add1-75be-4427-be78-23112aeeb508]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:39 devstack sudo[95788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc
Nov 02 10:09:39 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:40 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc" returned: 0 in 0.505s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f0ace2-2dea-466d-b47d-1985dea245dd]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:40 devstack sudo[95794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf
Nov 02 10:09:40 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-2d9913ae-7723-4056-bdcd-6681ce5183dc-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-2d9913ae-7723-4056-bdcd-6681ce5183dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Acquiring lock "cinder-quobyte-2d9913ae-7723-4056-bdcd-6681ce5183dc" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-2d9913ae-7723-4056-bdcd-6681ce5183dc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Deleting offline snapshot 2d9913ae-7723-4056-bdcd-6681ce5183dc of volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] snapshot_file for this snap is: volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79a91de-82b6-4899-96ba-7ae0311f325f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:40 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf" returned: 0 in 0.507s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25 not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:09:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:40 devstack sudo[95800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25
Nov 02 10:09:40 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:40 devstack sudo[95799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc
Nov 02 10:09:40 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:41 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc" returned: 0 in 0.468s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:41 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:41 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d315fac-969d-44c2-aee8-db404c689095]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:41 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:41 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:42 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 1.178s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:42 devstack sudo[95835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc
Nov 02 10:09:42 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:43 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc" returned: 0 in 1.200s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:43 devstack sudo[95842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc
Nov 02 10:09:43 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:44 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2d9913ae-7723-4056-bdcd-6681ce5183dc" returned: 0 in 0.668s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-2d9913ae-7723-4056-bdcd-6681ce5183dc" released by "_delete_snapshot" :: held 3.729s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" released by "delete_snapshot" :: held 3.779s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:44 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Created reservations ['5dff8112-3936-4e25-a577-a3963231d72c', 'd322ccba-406f-4137-b54a-ea65adcd5f0d', '02f40e61-eed1-4b09-a47b-077a0188abf5', '47dd7ce6-7a29-4ff4-a4db-f90baa918a94'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Delete snapshot completed successfully.
Nov 02 10:09:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-549b3a74-96ea-4a64-96e8-6df7af07da2a tempest-SnapshotsActionsTest-2073564142 None] Lock "cinder-2d9913ae-7723-4056-bdcd-6681ce5183dc-delete_snapshot" released by "delete_snapshot" :: held 4.322s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "cinder-2aa6bf9d-55a5-423f-b18f-1d0f0c05053b-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Lock "cinder-2aa6bf9d-55a5-423f-b18f-1d0f0c05053b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "cinder-quobyte-2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Lock "cinder-quobyte-2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Deleting offline snapshot 2aa6bf9d-55a5-423f-b18f-1d0f0c05053b of volume f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:09:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] snapshot_file for this snap is: volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:09:47 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[602fcb6f-6346-4f9a-92c4-e6b53719f349]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:47 devstack sudo[95882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:47 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:48 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.894s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:48 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef3f67e-2a2a-4fc4-8b2a-76b45d21dba7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:48 devstack sudo[95889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7
Nov 02 10:09:48 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:48 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" returned: 0 in 0.643s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:48 devstack sudo[95895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:48 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:49 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.971s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:49 devstack sudo[95900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b
Nov 02 10:09:49 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:50 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" returned: 0 in 9.490s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf, size 1024.00 MB, duration 9.49 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:09:50 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Converted 1024.00 MB image at 107.88 MB/s
Nov 02 10:09:50 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25 is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:50 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7.2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" returned: 0 in 0.555s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:UPDATE=120,cinder:SELECT=110,cinder:INSERT=30,cinder:DELETE=9 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:09:50 devstack sudo[95903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25
Nov 02 10:09:50 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Lock "cinder-quobyte-2aa6bf9d-55a5-423f-b18f-1d0f0c05053b" released by "_delete_snapshot" :: held 3.292s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" released by "delete_snapshot" :: held 3.336s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Created reservations ['42cd1efd-277f-41f6-afa1-2fd3efcce709', '383f5d87-f2ad-4b74-8d70-5f8cf9b0f16e', '17ce3d38-d6a8-429a-a18f-3f0136653941', '44f0fb14-5cf0-4352-b5cc-7b58cb52d3fa'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Delete snapshot completed successfully.
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b3068ec6-e24c-4c0b-ac06-b8865733cb7f tempest-SnapshotsActionsTest-1541338786 None] Lock "cinder-2aa6bf9d-55a5-423f-b18f-1d0f0c05053b-delete_snapshot" released by "delete_snapshot" :: held 3.586s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:50 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" returned: 0 in 0.296s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" released by "_copy_volume_from_snapshot" :: held 10.908s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-dc6d3641-feba-4433-884e-86fdac8bbdcc-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" released by "_create_volume_from_snapshot" :: held 11.015s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.050s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f2a282f7-bdae-4362-89f8-78fcc277024e tempest-GroupSnapshotsTest-262746101 None] Create group from source-snapshot-78fb5e82-cc5d-463c-9365-d8f739e50fd0 completed successfully.
Nov 02 10:09:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "cinder-f69f833e-bd7c-4054-ba3a-e3cec6f91da7-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Lock "cinder-f69f833e-bd7c-4054-ba3a-e3cec6f91da7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" acquired by "delete_volume" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:51 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a0f307-7edb-4122-bc72-6a39631af74e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:51 devstack sudo[95906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7
Nov 02 10:09:51 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:52 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" returned: 0 in 0.530s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:52 devstack sudo[95911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7
Nov 02 10:09:52 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[269bcbb4-b97c-4f19-b565-1fc3b6bd44a5]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:52 devstack sudo[95913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25
Nov 02 10:09:52 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:52 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" returned: 0 in 0.371s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Lock "cinder-quobyte-f69f833e-bd7c-4054-ba3a-e3cec6f91da7" released by "delete_volume" :: held 0.993s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Created reservations ['0c71bc7c-e706-4178-8cf8-5590a123fab6', '0c90cd31-7e5a-4312-be2a-c2b077a45bc0', 'f1592ae3-27e1-40d8-8bf4-67a6b5d24bda', 'a6457406-e87f-4ec2-85e9-cd17673c7331'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:52 devstack sudo[95918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:09:52 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:52 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" returned: 0 in 0.596s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:53 devstack sudo[95921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25
Nov 02 10:09:53 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:53 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.462s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:09:53 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Deleted volume successfully.
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e10e15b-a932-4885-bb09-6a4cc52dcc85 tempest-SnapshotsActionsTest-1541338786 None] Lock "cinder-f69f833e-bd7c-4054-ba3a-e3cec6f91da7-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:53 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" returned: 0 in 0.408s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-7ac11f3f-506e-44e5-ab7c-4af9ff3fee25" released by "delete_volume" :: held 1.070s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Created reservations ['6ba888cb-2e65-4eb7-b042-2837c199540b'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:53 devstack cinder-volume[87014]: WARNING cinder.quota [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2068766296 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2068766296, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:09:53 devstack cinder-volume[87014]: WARNING cinder.quota [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2068766296 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2068766296, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Created reservations ['ef465ae8-d8ac-4555-8d02-6ceff16d4d22', 'd929418f-bf98-42d0-8a20-ea5572dc7dc6', 'b049714a-6236-4411-833f-7c1e28d3e160', 'e1bd2782-1822-428f-afd0-eeac418a2065'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:53 devstack sudo[95925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:09:53 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:54 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.438s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:54 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:09:54 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e77ead63-f080-43de-89bc-db0c2a86e01f tempest-GroupSnapshotsTest-262746101 None] Delete group completed successfully.
Nov 02 10:09:54 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] group_snapshot 78fb5e82-cc5d-463c-9365-d8f739e50fd0: deleting
Nov 02 10:09:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] group_snapshot 78fb5e82-cc5d-463c-9365-d8f739e50fd0: deleting {{(pid=87014) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 02 10:09:54 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-0e24d05f-f3f0-46b6-aa39-019c02718dcf" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-0e24d05f-f3f0-46b6-aa39-019c02718dcf" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-dc6d3641-feba-4433-884e-86fdac8bbdcc" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-dc6d3641-feba-4433-884e-86fdac8bbdcc" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:55 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Deleting offline snapshot dc6d3641-feba-4433-884e-86fdac8bbdcc of volume 0e24d05f-f3f0-46b6-aa39-019c02718dcf {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:09:55 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] snapshot_file for this snap is: volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:09:55 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[82049db5-bdf7-4e2f-b258-00ba27d06ed0]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:55 devstack sudo[95928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc
Nov 02 10:09:55 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:55 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc" returned: 0 in 0.510s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:55 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:09:55 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8dfa5e-9b68-48e1-842e-83433a464732]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:55 devstack sudo[95933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf
Nov 02 10:09:55 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:56 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf" returned: 0 in 0.734s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:56 devstack sudo[95944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc
Nov 02 10:09:56 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:56 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc" returned: 0 in 0.439s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:56 devstack sudo[95952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc
Nov 02 10:09:56 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:57 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf.dc6d3641-feba-4433-884e-86fdac8bbdcc" returned: 0 in 0.343s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-dc6d3641-feba-4433-884e-86fdac8bbdcc" released by "_delete_snapshot" :: held 2.220s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-0e24d05f-f3f0-46b6-aa39-019c02718dcf" released by "delete_snapshot" :: held 2.255s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:57 devstack cinder-volume[87014]: WARNING cinder.quota [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2068766296 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2068766296, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:09:57 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] Created reservations ['b76b1d6f-2cd5-4492-a9f7-ef0c13d97457', 'ee6eb32d-2bce-4d28-adc7-e15d612708ce', '731a1de0-27b6-423b-92c9-e762b192d331', '12773278-df4b-4beb-9df2-ad64b4f3a618'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-adbc59db-61fc-4684-8aee-fe28a16d6ae6 tempest-GroupSnapshotsTest-262746101 None] group_snapshot 78fb5e82-cc5d-463c-9365-d8f739e50fd0: deleted successfully
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Flow 'volume_create_manager' (855ecda8-0d97-4f40-8531-dd4c29bebdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed47581-ca2e-4ff3-b09a-1c33ad9a556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed47581-ca2e-4ff3-b09a-1c33ad9a556e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1508047155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9791b616-e6aa-4ed5-9052-cfc9b78fd8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c155532ec9b44ada95ef282f0e9126b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:58Z,use_quota=True,user_id='710560e50ca34d80aa75ef580db0be5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97423ec9-3a64-45f9-91f0-14c1312957d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97423ec9-3a64-45f9-91f0-14c1312957d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9cb0a11-fcf9-452b-99c7-e7c24d960986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9cb0a11-fcf9-452b-99c7-e7c24d960986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9791b616-e6aa-4ed5-9052-cfc9b78fd8b9', 'volume_name': 'volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0eb683a-09a6-4cbe-95b6-f964ab9315b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0eb683a-09a6-4cbe-95b6-f964ab9315b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8020ae-7db4-4a13-ae4a-400688bf1366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:58 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Volume 9791b616-e6aa-4ed5-9052-cfc9b78fd8b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9', 'volume_size': 1}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1508047155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9791b616-e6aa-4ed5-9052-cfc9b78fd8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c155532ec9b44ada95ef282f0e9126b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:09:58Z,use_quota=True,user_id='710560e50ca34d80aa75ef580db0be5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Creating volume 9791b616-e6aa-4ed5-9052-cfc9b78fd8b9 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:09:58 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:58 devstack sudo[95958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9 1073741824
Nov 02 10:09:58 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-0e24d05f-f3f0-46b6-aa39-019c02718dcf" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-0e24d05f-f3f0-46b6-aa39-019c02718dcf" acquired by "delete_volume" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2b75e2-ee5d-40e9-ba50-e78a9935b052]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:09:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:59 devstack sudo[95962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf
Nov 02 10:09:59 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:59 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9 1073741824" returned: 0 in 0.665s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:59 devstack sudo[95966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9
Nov 02 10:09:59 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:59 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf" returned: 0 in 0.626s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:09:59 devstack sudo[95972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf
Nov 02 10:09:59 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:09:59 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9" returned: 0 in 0.336s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8020ae-7db4-4a13-ae4a-400688bf1366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4f512e-fb66-4d5a-a388-8b159aefa829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:09:59 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Volume volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9 (9791b616-e6aa-4ed5-9052-cfc9b78fd8b9): created successfully
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4f512e-fb66-4d5a-a388-8b159aefa829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Flow 'volume_create_manager' (855ecda8-0d97-4f40-8531-dd4c29bebdfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:09:59 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-7d57c2fc-ee8e-4a39-9418-412e008e71d6 tempest-AttachVolumeNegativeTest-1334827169 None] Created volume successfully.
Nov 02 10:09:59 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0e24d05f-f3f0-46b6-aa39-019c02718dcf" returned: 0 in 0.376s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-0e24d05f-f3f0-46b6-aa39-019c02718dcf" released by "delete_volume" :: held 1.117s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:09:59 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Created reservations ['e258607a-f418-4576-99fa-95235e943fbf'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:09:59 devstack cinder-volume[87014]: WARNING cinder.db.api [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2068766296']
Nov 02 10:10:00 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Created reservations ['9afaef09-e619-4002-9e22-60d5ee523436', '858719f5-22fd-4f70-8ffe-348e1c56769d', 'da95915a-5ea4-4668-ad8e-d4bf42a09985', '24079234-e279-492d-933f-527ae16da0cb'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:10:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:10:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:00 devstack sudo[95976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:10:00 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:00 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.331s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:00 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:10:00 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b1bcc3c6-7d18-433f-b505-eee5a2e32187 tempest-GroupSnapshotsTest-262746101 None] Delete group completed successfully.
Nov 02 10:10:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ce5d33da-7c73-4106-83d9-ee804e79ad4c req-e66195b6-a016-4450-aec1-af03fcec98d0 tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ce5d33da-7c73-4106-83d9-ee804e79ad4c req-e66195b6-a016-4450-aec1-af03fcec98d0 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ce5d33da-7c73-4106-83d9-ee804e79ad4c req-e66195b6-a016-4450-aec1-af03fcec98d0 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-ce5d33da-7c73-4106-83d9-ee804e79ad4c req-e66195b6-a016-4450-aec1-af03fcec98d0 tempest-AttachVolumeNegativeTest-1334827169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31dc3bc0-4687-4e5a-bc54-4b94dff0d141', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:10:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-ce5d33da-7c73-4106-83d9-ee804e79ad4c req-e66195b6-a016-4450-aec1-af03fcec98d0 tempest-AttachVolumeNegativeTest-1334827169 None] attachment_update completed successfully.
Nov 02 10:10:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-257764e5-a4a1-4d05-bcf3-bf5825992cf8 tempest-GroupSnapshotsTest-262746101 None] Group tempest-GroupSnapshotsTest-Group-1350013567: creating
Nov 02 10:10:02 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-257764e5-a4a1-4d05-bcf3-bf5825992cf8 tempest-GroupSnapshotsTest-262746101 None] Group tempest-GroupSnapshotsTest-Group-1350013567: created successfully
Nov 02 10:10:02 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-257764e5-a4a1-4d05-bcf3-bf5825992cf8 tempest-GroupSnapshotsTest-262746101 None] Create group completed successfully.
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Flow 'volume_create_manager' (550104d3-56fb-48c8-8221-70113b3b2762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256943f7-a5e0-483a-a9d0-542eb775cf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256943f7-a5e0-483a-a9d0-542eb775cf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-540706947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=48dda918-bad8-4528-a88d-b6e18f3c6dd5,host='devstack@QuobyteHD#QuobyteHD',id=ba174784-9b00-4d58-8f9b-a284d5f77bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5d133ecd09439785a63d6d87670e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:04Z,use_quota=True,user_id='e3c13430ae1a4b00af80511eb576879f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5b05bd8-298a-4a39-b15f-3873ca375b38),volume_type_id=d5b05bd8-298a-4a39-b15f-3873ca375b38)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa6cf28-bafb-4cd8-b3ec-c67e368a8a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa6cf28-bafb-4cd8-b3ec-c67e368a8a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026a42cb-d268-40c4-9817-c969007f9d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026a42cb-d268-40c4-9817-c969007f9d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba174784-9b00-4d58-8f9b-a284d5f77bb6', 'volume_name': 'volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9971b11c-9412-43e0-8a3d-f59c5ae31939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9971b11c-9412-43e0-8a3d-f59c5ae31939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad86131f-bf18-4f61-bb81-e4a32f96e98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:04 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Volume ba174784-9b00-4d58-8f9b-a284d5f77bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6', 'volume_size': 1}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=48dda918-bad8-4528-a88d-b6e18f3c6dd5,created_at=2026-11-02T09:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-540706947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=48dda918-bad8-4528-a88d-b6e18f3c6dd5,host='devstack@QuobyteHD#QuobyteHD',id=ba174784-9b00-4d58-8f9b-a284d5f77bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5d133ecd09439785a63d6d87670e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:04Z,use_quota=True,user_id='e3c13430ae1a4b00af80511eb576879f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5b05bd8-298a-4a39-b15f-3873ca375b38),volume_type_id=d5b05bd8-298a-4a39-b15f-3873ca375b38)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Creating volume ba174784-9b00-4d58-8f9b-a284d5f77bb6 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:10:04 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:04 devstack sudo[96411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 1073741824
Nov 02 10:10:04 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:04 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 1073741824" returned: 0 in 0.699s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:04 devstack sudo[96445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6
Nov 02 10:10:04 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:05 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-a30d6353-9990-49f1-8c5b-f4a28924540e req-b72dbc93-54f3-43a5-84fa-f2d3c7d98d7b tempest-AttachVolumeNegativeTest-1334827169 None] Terminate volume connection completed successfully.
Nov 02 10:10:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-a30d6353-9990-49f1-8c5b-f4a28924540e req-b72dbc93-54f3-43a5-84fa-f2d3c7d98d7b tempest-AttachVolumeNegativeTest-1334827169 None] Deleting attachment 31dc3bc0-4687-4e5a-bc54-4b94dff0d141. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:10:05 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6" returned: 0 in 0.373s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:10:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad86131f-bf18-4f61-bb81-e4a32f96e98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e268b522-b80f-4bb5-a48f-a68589865563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:05 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Volume volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 (ba174784-9b00-4d58-8f9b-a284d5f77bb6): created successfully
Nov 02 10:10:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e268b522-b80f-4bb5-a48f-a68589865563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Flow 'volume_create_manager' (550104d3-56fb-48c8-8221-70113b3b2762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:10:05 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-645f1a31-f9c9-4a7d-95cc-82e424aabbd6 tempest-GroupSnapshotsTest-262746101 None] Created volume successfully.
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:07 devstack sudo[96469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:10:07 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:07 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.601s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Flow 'volume_create_manager' (376d5a4a-406a-4bcc-9aa9-bfdb03ef41c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f168cc4-aeca-496a-8180-7ab893d05ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f168cc4-aeca-496a-8180-7ab893d05ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-419815702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=48dda918-bad8-4528-a88d-b6e18f3c6dd5,host='devstack@QuobyteHD#QuobyteHD',id=6aebda13-a2d6-4456-97f4-0ad4e7b9fab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5d133ecd09439785a63d6d87670e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:08Z,use_quota=True,user_id='e3c13430ae1a4b00af80511eb576879f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5b05bd8-298a-4a39-b15f-3873ca375b38),volume_type_id=d5b05bd8-298a-4a39-b15f-3873ca375b38)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9cf9ae1-ffcb-4986-916e-8e7ac6a891dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9cf9ae1-ffcb-4986-916e-8e7ac6a891dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd27fd79-fcdb-4330-9e57-7fbad9d0563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd27fd79-fcdb-4330-9e57-7fbad9d0563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aebda13-a2d6-4456-97f4-0ad4e7b9fab8', 'volume_name': 'volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba813e8f-1866-4c3b-be48-395deb96aab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba813e8f-1866-4c3b-be48-395deb96aab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa4b088-628d-46de-ae38-80fea51ffe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:08 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Volume 6aebda13-a2d6-4456-97f4-0ad4e7b9fab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8', 'volume_size': 1}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=48dda918-bad8-4528-a88d-b6e18f3c6dd5,created_at=2026-11-02T09:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-419815702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=48dda918-bad8-4528-a88d-b6e18f3c6dd5,host='devstack@QuobyteHD#QuobyteHD',id=6aebda13-a2d6-4456-97f4-0ad4e7b9fab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5d133ecd09439785a63d6d87670e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:08Z,use_quota=True,user_id='e3c13430ae1a4b00af80511eb576879f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5b05bd8-298a-4a39-b15f-3873ca375b38),volume_type_id=d5b05bd8-298a-4a39-b15f-3873ca375b38)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Creating volume 6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:10:08 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:08 devstack sudo[96485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 1073741824
Nov 02 10:10:08 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:08 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 1073741824" returned: 0 in 0.868s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:09 devstack sudo[96519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8
Nov 02 10:10:09 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:09 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8" returned: 0 in 0.623s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:10:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa4b088-628d-46de-ae38-80fea51ffe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b817d44a-0f03-4361-9b9f-9cc24c39d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:09 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Volume volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 (6aebda13-a2d6-4456-97f4-0ad4e7b9fab8): created successfully
Nov 02 10:10:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b817d44a-0f03-4361-9b9f-9cc24c39d08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Flow 'volume_create_manager' (376d5a4a-406a-4bcc-9aa9-bfdb03ef41c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:10:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c5d93b58-c74b-42da-81af-d086e689bd86 tempest-GroupSnapshotsTest-262746101 None] Created volume successfully.
Nov 02 10:10:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-413edbe0-27b1-4efb-ba25-887742dc48c7 tempest-GroupSnapshotsTest-262746101 None] Update group completed successfully.
Nov 02 10:10:12 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3fa09038-8a41-4d0d-a04d-2d5af8368eb3 tempest-GroupSnapshotsTest-262746101 None] Update group completed successfully.
Nov 02 10:10:13 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-21d1c780-4bf1-4def-84ac-000539edb40f tempest-GroupSnapshotsTest-262746101 None] Update group completed successfully.
Nov 02 10:10:14 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-79d0771b-3034-4639-b748-0300d249be02 tempest-GroupSnapshotsTest-262746101 None] Update group completed successfully.
Nov 02 10:10:16 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] GroupSnapshot c86eea99-4cc2-42e2-b5b8-b33232abe1a2: creating.
Nov 02 10:10:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Group snapshot c86eea99-4cc2-42e2-b5b8-b33232abe1a2: creating. {{(pid=87014) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 02 10:10:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Creating offline snapshot 69d7d45a-ba44-4f45-a8b5-deda08de8547 of volume ba174784-9b00-4d58-8f9b-a284d5f77bb6 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:10:16 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a6360e-fbf0-44bb-807f-641f7a858ca8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:16 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6
Nov 02 10:10:16 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:17 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6" returned: 0 in 0.741s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:17 devstack sudo[96537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547 1G
Nov 02 10:10:17 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:18 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547 1G" returned: 0 in 0.709s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:18 devstack sudo[96557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547
Nov 02 10:10:18 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:18 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547" returned: 0 in 0.431s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:18 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547 is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:10:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:18 devstack sudo[96562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547
Nov 02 10:10:18 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:18 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547" returned: 0 in 0.396s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:19 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=117,cinder:UPDATE=116,cinder:INSERT=29,cinder:DELETE=5 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:10:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:19 devstack sudo[96565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.info
Nov 02 10:10:19 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:19 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.info" returned: 0 in 0.354s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:19 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:10:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:19 devstack sudo[96568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.info
Nov 02 10:10:19 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:19 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.info" returned: 0 in 0.337s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Creating offline snapshot a8256e90-922e-4c06-9d46-4038a9ae2390 of volume 6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:10:19 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9b61a4-20d9-4e39-a7f1-8bde5e2bb7f8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:19 devstack sudo[96571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8
Nov 02 10:10:19 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:20 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8" returned: 0 in 0.487s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:20 devstack sudo[96576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390 1G
Nov 02 10:10:20 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:20 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390 1G" returned: 0 in 0.664s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:21 devstack sudo[96582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390
Nov 02 10:10:21 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:21 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390" returned: 0 in 0.492s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:21 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390 is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:10:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:21 devstack sudo[96589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390
Nov 02 10:10:21 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:21 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390" returned: 0 in 0.384s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:21 devstack sudo[96592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.info
Nov 02 10:10:21 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:22 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.info" returned: 0 in 0.414s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:22 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:10:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:22 devstack sudo[96595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.info
Nov 02 10:10:22 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:23 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.info" returned: 0 in 0.760s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.381s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:23 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-47a8d9f8-d624-4934-9813-01540b6df2b1 tempest-GroupSnapshotsTest-262746101 None] group_snapshot c86eea99-4cc2-42e2-b5b8-b33232abe1a2: created successfully
Nov 02 10:10:24 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] group_snapshot c86eea99-4cc2-42e2-b5b8-b33232abe1a2: deleting
Nov 02 10:10:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] group_snapshot c86eea99-4cc2-42e2-b5b8-b33232abe1a2: deleting {{(pid=87014) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 02 10:10:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-ba174784-9b00-4d58-8f9b-a284d5f77bb6" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-ba174784-9b00-4d58-8f9b-a284d5f77bb6" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-69d7d45a-ba44-4f45-a8b5-deda08de8547" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-69d7d45a-ba44-4f45-a8b5-deda08de8547" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Deleting offline snapshot 69d7d45a-ba44-4f45-a8b5-deda08de8547 of volume ba174784-9b00-4d58-8f9b-a284d5f77bb6 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:10:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] snapshot_file for this snap is: volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:10:24 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1fe2a7-7435-4916-940a-955830b60d8f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:25 devstack sudo[96665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547
Nov 02 10:10:25 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:25 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547" returned: 0 in 0.648s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:10:25 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd7bba5-b7d7-409f-9dd5-5ae4b6755f7c]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:26 devstack sudo[96670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6
Nov 02 10:10:26 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:26 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6" returned: 0 in 0.930s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:26 devstack sudo[96675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547
Nov 02 10:10:26 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:27 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547" returned: 0 in 0.582s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:27 devstack sudo[96680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547
Nov 02 10:10:27 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:27 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6.69d7d45a-ba44-4f45-a8b5-deda08de8547" returned: 0 in 0.401s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-69d7d45a-ba44-4f45-a8b5-deda08de8547" released by "_delete_snapshot" :: held 2.820s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-ba174784-9b00-4d58-8f9b-a284d5f77bb6" released by "delete_snapshot" :: held 2.883s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-a8256e90-922e-4c06-9d46-4038a9ae2390" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-a8256e90-922e-4c06-9d46-4038a9ae2390" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Deleting offline snapshot a8256e90-922e-4c06-9d46-4038a9ae2390 of volume 6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] snapshot_file for this snap is: volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d37bff3-d6ce-42b0-ba89-8f6772caf975]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:27 devstack sudo[96683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390
Nov 02 10:10:27 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:28 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390" returned: 0 in 0.553s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:10:28 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58a11f9-70b7-49f4-854c-cc8b7ee281b4]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:28 devstack sudo[96690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8
Nov 02 10:10:28 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:28 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8" returned: 0 in 0.578s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:29 devstack sudo[96695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390
Nov 02 10:10:29 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:29 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390" returned: 0 in 0.665s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:29 devstack sudo[96700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390
Nov 02 10:10:29 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:30 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8.a8256e90-922e-4c06-9d46-4038a9ae2390" returned: 0 in 0.412s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-a8256e90-922e-4c06-9d46-4038a9ae2390" released by "_delete_snapshot" :: held 2.423s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8" released by "delete_snapshot" :: held 2.461s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:30 devstack cinder-volume[87014]: WARNING cinder.quota [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1936274106 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1936274106, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:10:30 devstack cinder-volume[87014]: WARNING cinder.quota [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1936274106 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1936274106, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:10:30 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Created reservations ['cba99adb-3aab-4cc6-8eca-31eeb3093847', 'cd15c485-3b56-4960-af6f-c1abf7e7251b', 'c1e30f1c-3afe-4d88-9dd0-0772aa7e9271', '5e71eafd-3285-456e-9445-0a9c634257a9'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:30 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] Created reservations ['1b6066bb-fe1b-497b-aac8-663ff4c06295', 'a7d8575e-ee2b-441d-835d-8b3058a20548', '088f19ac-711e-4eb1-b197-e356699ea7cb', '66fed418-1714-47d9-955c-f81bbc2db0b8'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:30 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-409d152e-a5de-4028-a01d-4a8c0b247c22 tempest-GroupSnapshotsTest-262746101 None] group_snapshot c86eea99-4cc2-42e2-b5b8-b33232abe1a2: deleted successfully
Nov 02 10:10:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:31 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6d8dce-0f31-440c-9538-1f35b2e28429]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:31 devstack sudo[96704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8
Nov 02 10:10:31 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:32 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8" returned: 0 in 0.835s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:32 devstack sudo[96710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8
Nov 02 10:10:32 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:33 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8" returned: 0 in 0.603s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-6aebda13-a2d6-4456-97f4-0ad4e7b9fab8" released by "delete_volume" :: held 1.563s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-ba174784-9b00-4d58-8f9b-a284d5f77bb6" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-ba174784-9b00-4d58-8f9b-a284d5f77bb6" acquired by "delete_volume" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[af813661-75ae-4dee-ab93-af8faf1f0cd6]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:33 devstack sudo[96713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6
Nov 02 10:10:33 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:34 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6" returned: 0 in 0.915s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:34 devstack sudo[96718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6
Nov 02 10:10:34 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:34 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-ba174784-9b00-4d58-8f9b-a284d5f77bb6" returned: 0 in 0.483s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-ba174784-9b00-4d58-8f9b-a284d5f77bb6" released by "delete_volume" :: held 1.534s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:34 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Created reservations ['b75fa76d-c59d-4c42-a58f-a0553e9cfa3c'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:34 devstack cinder-volume[87014]: WARNING cinder.quota [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1936274106 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1936274106, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:10:34 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Created reservations ['3882603e-4f6c-4194-b7c8-be8e8b611748', '9e92f85a-bcfc-48e4-b879-70434cd1e1fc', '9f796469-fb96-4603-bc74-854b0dcf9a0b', '177a0092-d347-4de3-9c46-d0332e280bb2'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:35 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Created reservations ['f3e232e2-a25b-46a3-be3e-e65ebe439bdc', '6a475619-b79b-4e13-9940-605350ab1113', '92d331cd-9d1e-4d17-9f14-824c9000c8fc', 'cb1a5d66-3715-4e79-a82d-c14a34b213ed'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:10:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:10:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:35 devstack sudo[96721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:10:35 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:36 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.704s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:10:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-146652b3-3a3d-4255-8d94-15f3c79205a6 tempest-GroupSnapshotsTest-262746101 None] Delete group completed successfully.
Nov 02 10:10:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1e9aa731-8650-401f-b3b4-b8bcd33710cf tempest-GroupSnapshotsTest-262746101 None] Group tempest-GroupSnapshotsTest-Group-1664348852: creating
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Flow 'volume_create_manager' (619f786a-271b-44b2-8c11-e3701396df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe7a140-68fe-4d0f-81ea-6b5091c13a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe7a140-68fe-4d0f-81ea-6b5091c13a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-491143533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb9375e-5e08-451a-825a-2a9f433d2f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31f350b2bed4f9e9def73d08878d94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:36Z,use_quota=True,user_id='3761154411934003b7faf34f1ab77783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4150c206-f3fb-4cfb-83a1-84b9aed7018b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4150c206-f3fb-4cfb-83a1-84b9aed7018b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2fd5e2-c066-4c93-88d5-403270d65224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2fd5e2-c066-4c93-88d5-403270d65224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb9375e-5e08-451a-825a-2a9f433d2f8e', 'volume_name': 'volume-feb9375e-5e08-451a-825a-2a9f433d2f8e', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702f2d29-1466-4821-9191-b36b50e1a45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702f2d29-1466-4821-9191-b36b50e1a45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77972b67-af2b-43f3-b770-83fbd214630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:36 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Volume feb9375e-5e08-451a-825a-2a9f433d2f8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb9375e-5e08-451a-825a-2a9f433d2f8e', 'volume_size': 1}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-491143533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb9375e-5e08-451a-825a-2a9f433d2f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31f350b2bed4f9e9def73d08878d94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:36Z,use_quota=True,user_id='3761154411934003b7faf34f1ab77783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Creating volume feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:10:36 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:10:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1e9aa731-8650-401f-b3b4-b8bcd33710cf tempest-GroupSnapshotsTest-262746101 None] Group tempest-GroupSnapshotsTest-Group-1664348852: created successfully
Nov 02 10:10:36 devstack sudo[96727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e 1073741824
Nov 02 10:10:36 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1e9aa731-8650-401f-b3b4-b8bcd33710cf tempest-GroupSnapshotsTest-262746101 None] Create group completed successfully.
Nov 02 10:10:37 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e 1073741824" returned: 0 in 0.797s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:37 devstack sudo[96758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e
Nov 02 10:10:37 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:37 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e" returned: 0 in 0.372s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:10:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77972b67-af2b-43f3-b770-83fbd214630d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb9375e-5e08-451a-825a-2a9f433d2f8e', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf31db1-9158-4dab-b246-c358391f4da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:37 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Volume volume-feb9375e-5e08-451a-825a-2a9f433d2f8e (feb9375e-5e08-451a-825a-2a9f433d2f8e): created successfully
Nov 02 10:10:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf31db1-9158-4dab-b246-c358391f4da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Flow 'volume_create_manager' (619f786a-271b-44b2-8c11-e3701396df39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:10:37 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-05fc7d67-951d-4cb8-bf74-ee665ec64b9e tempest-VolumesDeleteCascade-635963858 None] Created volume successfully.
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Flow 'volume_create_manager' (284a262c-c335-4413-a666-ba4f76bb42f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad785cf-c1fa-4b2c-a821-bd04217b9b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad785cf-c1fa-4b2c-a821-bd04217b9b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-511474218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=32a3bc10-800a-48ab-afed-fb2dc8e0b55b,host='devstack@QuobyteHD#QuobyteHD',id=b4dac214-6994-4002-8d01-8150a516fa0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5d133ecd09439785a63d6d87670e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:38Z,use_quota=True,user_id='e3c13430ae1a4b00af80511eb576879f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e64fccc-dd15-4b9f-bb3d-ee7f4106fb4b),volume_type_id=5e64fccc-dd15-4b9f-bb3d-ee7f4106fb4b)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d3073a-c49c-4b81-b8f3-e1509e388453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d3073a-c49c-4b81-b8f3-e1509e388453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e80bc67-3285-4558-b566-dc96d1a153d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e80bc67-3285-4558-b566-dc96d1a153d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4dac214-6994-4002-8d01-8150a516fa0b', 'volume_name': 'volume-b4dac214-6994-4002-8d01-8150a516fa0b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9847f68e-e74e-45b6-bf20-eea20665a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9847f68e-e74e-45b6-bf20-eea20665a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7651f3-2c76-4c10-ad5d-91cd1bcf0dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:38 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Volume b4dac214-6994-4002-8d01-8150a516fa0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4dac214-6994-4002-8d01-8150a516fa0b', 'volume_size': 1}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=32a3bc10-800a-48ab-afed-fb2dc8e0b55b,created_at=2026-11-02T09:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-511474218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=32a3bc10-800a-48ab-afed-fb2dc8e0b55b,host='devstack@QuobyteHD#QuobyteHD',id=b4dac214-6994-4002-8d01-8150a516fa0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5d133ecd09439785a63d6d87670e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:38Z,use_quota=True,user_id='e3c13430ae1a4b00af80511eb576879f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e64fccc-dd15-4b9f-bb3d-ee7f4106fb4b),volume_type_id=5e64fccc-dd15-4b9f-bb3d-ee7f4106fb4b)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Creating volume b4dac214-6994-4002-8d01-8150a516fa0b {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:10:38 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:38 devstack sudo[96762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b 1073741824
Nov 02 10:10:38 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:38 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b 1073741824" returned: 0 in 0.533s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:39 devstack sudo[96768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b
Nov 02 10:10:39 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:39 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b" returned: 0 in 0.266s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.672s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7651f3-2c76-4c10-ad5d-91cd1bcf0dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4dac214-6994-4002-8d01-8150a516fa0b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d208ffb6-0bca-4c84-a298-f998b20d8ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] Creating offline snapshot 1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 of volume feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:10:39 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Volume volume-b4dac214-6994-4002-8d01-8150a516fa0b (b4dac214-6994-4002-8d01-8150a516fa0b): created successfully
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d208ffb6-0bca-4c84-a298-f998b20d8ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Flow 'volume_create_manager' (284a262c-c335-4413-a666-ba4f76bb42f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f548cb9-817a-4f06-aa5a-19ac6e514a61]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d759b833-3c3c-4864-85fb-3624529c5b3f tempest-GroupSnapshotsTest-262746101 None] Created volume successfully.
Nov 02 10:10:39 devstack sudo[96771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e
Nov 02 10:10:39 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:39 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e" returned: 0 in 0.455s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] GroupSnapshot de3408a7-0e8b-4482-bf1a-0cd6fb9c612c: creating.
Nov 02 10:10:39 devstack sudo[96776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 1G
Nov 02 10:10:39 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] Group snapshot de3408a7-0e8b-4482-bf1a-0cd6fb9c612c: creating. {{(pid=87014) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 02 10:10:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:40 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 1G" returned: 0 in 0.503s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb9375e-5e08-451a-825a-2a9f433d2f8e -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:40 devstack sudo[96782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb9375e-5e08-451a-825a-2a9f433d2f8e -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19
Nov 02 10:10:40 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:40 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb9375e-5e08-451a-825a-2a9f433d2f8e -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19" returned: 0 in 0.325s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:40 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 is being set with open permissions: ugo+rw
Nov 02 10:10:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:40 devstack sudo[96789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19
Nov 02 10:10:40 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:40 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19" returned: 0 in 0.275s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:40 devstack sudo[96792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.info
Nov 02 10:10:40 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:41 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.info" returned: 0 in 0.255s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:41 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.info is being set with open permissions: ugo+rw
Nov 02 10:10:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:41 devstack sudo[96795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.info
Nov 02 10:10:41 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:41 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.info" returned: 0 in 0.278s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.681s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:41 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] Creating offline snapshot c81558fe-b889-4b1a-a4db-c7906ab7c85e of volume b4dac214-6994-4002-8d01-8150a516fa0b {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:10:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-cb77bb56-c447-4c38-96dc-00a061e2a62d tempest-VolumesDeleteCascade-635963858 None] Create snapshot completed successfully
Nov 02 10:10:41 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca72ba14-d06b-4e78-b7e1-3befad51cf45]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:41 devstack sudo[96798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b
Nov 02 10:10:41 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:42 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b" returned: 0 in 0.532s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:42 devstack sudo[96803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e 1G
Nov 02 10:10:42 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:42 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e 1G" returned: 0 in 0.464s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4dac214-6994-4002-8d01-8150a516fa0b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:42 devstack sudo[96809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4dac214-6994-4002-8d01-8150a516fa0b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e
Nov 02 10:10:42 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:42 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4dac214-6994-4002-8d01-8150a516fa0b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e" returned: 0 in 0.333s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:42 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:10:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:42 devstack sudo[96815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e
Nov 02 10:10:42 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:43 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e" returned: 0 in 0.277s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:43 devstack sudo[96818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.info
Nov 02 10:10:43 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:43 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.info" returned: 0 in 0.275s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:43 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:10:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:43 devstack sudo[96821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.info
Nov 02 10:10:43 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:43 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.info" returned: 0 in 0.292s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.718s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] Creating offline snapshot 7ed94706-2109-4f3d-94d1-40b277fa1a87 of volume feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:10:43 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6890e37b-1d55-4682-b1fc-46de840c85c1]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-bb009ada-3055-4610-b1e7-2340d1184175 tempest-GroupSnapshotsTest-262746101 None] group_snapshot de3408a7-0e8b-4482-bf1a-0cd6fb9c612c: created successfully
Nov 02 10:10:44 devstack sudo[96824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19
Nov 02 10:10:44 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] group_snapshot de3408a7-0e8b-4482-bf1a-0cd6fb9c612c: deleting
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] group_snapshot de3408a7-0e8b-4482-bf1a-0cd6fb9c612c: deleting {{(pid=87014) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-b4dac214-6994-4002-8d01-8150a516fa0b" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-b4dac214-6994-4002-8d01-8150a516fa0b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-c81558fe-b889-4b1a-a4db-c7906ab7c85e" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-c81558fe-b889-4b1a-a4db-c7906ab7c85e" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Deleting offline snapshot c81558fe-b889-4b1a-a4db-c7906ab7c85e of volume b4dac214-6994-4002-8d01-8150a516fa0b {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:10:44 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] snapshot_file for this snap is: volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19" returned: 0 in 0.726s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feb9375e-5e08-451a-825a-2a9f433d2f8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4584739-3600-41ef-83dc-75d32bb4ebb6]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:44 devstack sudo[96829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 1G
Nov 02 10:10:44 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:44 devstack sudo[96830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e
Nov 02 10:10:44 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:45 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e" returned: 0 in 0.577s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4dac214-6994-4002-8d01-8150a516fa0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:10:45 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e2ea0-fc83-40fc-9e75-18f6ded3e669]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:45 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 1G" returned: 0 in 0.778s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:45 devstack sudo[96840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b
Nov 02 10:10:45 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:45 devstack sudo[96841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87
Nov 02 10:10:45 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:45 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b" returned: 0 in 0.534s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:45 devstack sudo[96850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e
Nov 02 10:10:45 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:46 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87" returned: 0 in 0.491s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:46 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 is being set with open permissions: ugo+rw
Nov 02 10:10:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:46 devstack sudo[96853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87
Nov 02 10:10:46 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:46 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87" returned: 0 in 0.290s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:46 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f4671284-2c95-4d96-83db-b154eb5d5f2e tempest-VolumesDeleteCascade-635963858 None] Create snapshot completed successfully
Nov 02 10:10:46 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e" returned: 0 in 0.489s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:46 devstack sudo[96860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e
Nov 02 10:10:46 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:46 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b.c81558fe-b889-4b1a-a4db-c7906ab7c85e" returned: 0 in 0.327s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-c81558fe-b889-4b1a-a4db-c7906ab7c85e" released by "_delete_snapshot" :: held 2.151s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-b4dac214-6994-4002-8d01-8150a516fa0b" released by "delete_snapshot" :: held 2.211s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:46 devstack cinder-volume[87014]: WARNING cinder.quota [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-528864112 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-528864112, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:10:46 devstack cinder-volume[87014]: WARNING cinder.quota [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-528864112 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-528864112, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:10:46 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] Created reservations ['94c0935f-bde6-43c3-a5c2-10c0fdf7967a', '099ba477-56fe-4066-ba40-92922bbc82a9', '76e820de-b2ad-43a5-8246-4e41996ff591', 'a9e69bca-ca44-4b6b-9ee4-c4d26f51ea71'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Flow 'volume_create_manager' (051fbb21-7a60-47af-b536-3c351b4dc658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526b9a2a-148a-4282-87a2-2dc1c490fd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526b9a2a-148a-4282-87a2-2dc1c490fd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-590202891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e488e6c8-f598-4a8b-825f-9c09b7c8baf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c155532ec9b44ada95ef282f0e9126b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:47Z,use_quota=True,user_id='710560e50ca34d80aa75ef580db0be5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c246405c-259b-403d-b242-506499e4c71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c246405c-259b-403d-b242-506499e4c71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc580d7-f6f0-4a2e-8971-a6a959967e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc580d7-f6f0-4a2e-8971-a6a959967e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e488e6c8-f598-4a8b-825f-9c09b7c8baf3', 'volume_name': 'volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9ff96d-6928-4187-b9a6-da7356aac1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9ff96d-6928-4187-b9a6-da7356aac1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecd69e3-cd56-498a-a7e4-b55730a3efb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:47 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Volume e488e6c8-f598-4a8b-825f-9c09b7c8baf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3', 'volume_size': 1}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-590202891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e488e6c8-f598-4a8b-825f-9c09b7c8baf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c155532ec9b44ada95ef282f0e9126b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:10:47Z,use_quota=True,user_id='710560e50ca34d80aa75ef580db0be5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Creating volume e488e6c8-f598-4a8b-825f-9c09b7c8baf3 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:10:47 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6cc70af4-3e16-406f-af64-77f2af48d72c tempest-GroupSnapshotsTest-262746101 None] group_snapshot de3408a7-0e8b-4482-bf1a-0cd6fb9c612c: deleted successfully
Nov 02 10:10:47 devstack sudo[96863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3 1073741824
Nov 02 10:10:47 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-feb9375e-5e08-451a-825a-2a9f433d2f8e-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-feb9375e-5e08-451a-825a-2a9f433d2f8e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Performing cascade delete. {{(pid=87014) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-1e8d9b08-4166-44f2-ba4f-262e3a4c3c19-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-1e8d9b08-4166-44f2-ba4f-262e3a4c3c19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-quobyte-feb9375e-5e08-451a-825a-2a9f433d2f8e" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-feb9375e-5e08-451a-825a-2a9f433d2f8e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-quobyte-1e8d9b08-4166-44f2-ba4f-262e3a4c3c19" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-1e8d9b08-4166-44f2-ba4f-262e3a4c3c19" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Deleting offline snapshot 1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 of volume feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] snapshot_file for this snap is: volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[708193d0-b8b7-4522-ad72-1243951d1e48]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:47 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3 1073741824" returned: 0 in 0.757s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:48 devstack sudo[96870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3
Nov 02 10:10:48 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:48 devstack sudo[96869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19
Nov 02 10:10:48 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:48 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3" returned: 0 in 0.401s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecd69e3-cd56-498a-a7e4-b55730a3efb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b664054-bd20-4d03-8f59-14c0e60e7575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:48 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Volume volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3 (e488e6c8-f598-4a8b-825f-9c09b7c8baf3): created successfully
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b664054-bd20-4d03-8f59-14c0e60e7575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Flow 'volume_create_manager' (051fbb21-7a60-47af-b536-3c351b4dc658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:10:48 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e048ac8c-0a48-434e-b96a-1a3135d9e922 tempest-AttachVolumeNegativeTest-1334827169 None] Created volume successfully.
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19" returned: 0 in 0.582s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feb9375e-5e08-451a-825a-2a9f433d2f8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d173c-2d92-434c-83f2-9cc57fe9df02]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "cinder-quobyte-b4dac214-6994-4002-8d01-8150a516fa0b" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-b4dac214-6994-4002-8d01-8150a516fa0b" acquired by "delete_volume" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8853642a-a093-4fb2-8d83-d4075ff68941]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:48 devstack sudo[96878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e
Nov 02 10:10:48 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:48 devstack sudo[96879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b
Nov 02 10:10:48 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:49 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e" returned: 0 in 0.508s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d9e2db-2a58-420d-9626-b5366d6acd2c]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:49 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b" returned: 0 in 0.503s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:49 devstack sudo[96890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b
Nov 02 10:10:49 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:49 devstack sudo[96888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87
Nov 02 10:10:49 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:49 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b4dac214-6994-4002-8d01-8150a516fa0b" returned: 0 in 0.358s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Lock "cinder-quobyte-b4dac214-6994-4002-8d01-8150a516fa0b" released by "delete_volume" :: held 0.948s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:49 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87" returned: 0 in 0.527s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feb9375e-5e08-451a-825a-2a9f433d2f8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8730233a-1a8a-4ac1-b3de-c827e2fb2c6e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Created reservations ['cb27daa0-fd91-4014-a8e7-0d23afaa1490'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:49 devstack cinder-volume[87014]: WARNING cinder.quota [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-528864112 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-528864112, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:10:49 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Created reservations ['7ae3d395-7700-4e9a-8344-7e760198e877', '5235aa3b-c572-496d-b0d5-b2db017b3c14', 'a07ba8bc-972d-4626-98d0-27c1463b9a25', 'b78a3155-b1d3-4638-a34d-57bffd05d3eb'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:49 devstack sudo[96899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19
Nov 02 10:10:49 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:50 devstack sudo[96909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:10:50 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-a05a3996-0e78-449d-9448-711fec30962a req-efbf1dd1-4557-4315-b92b-5cdb9d5dc697 tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-a05a3996-0e78-449d-9448-711fec30962a req-efbf1dd1-4557-4315-b92b-5cdb9d5dc697 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-a05a3996-0e78-449d-9448-711fec30962a req-efbf1dd1-4557-4315-b92b-5cdb9d5dc697 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-a05a3996-0e78-449d-9448-711fec30962a req-efbf1dd1-4557-4315-b92b-5cdb9d5dc697 tempest-AttachVolumeNegativeTest-1334827169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc6887fb-4631-494b-b5c2-bdec0c6fda80', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:10:50 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19" returned: 0 in 0.601s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feb9375e-5e08-451a-825a-2a9f433d2f8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:10:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-a05a3996-0e78-449d-9448-711fec30962a req-efbf1dd1-4557-4315-b92b-5cdb9d5dc697 tempest-AttachVolumeNegativeTest-1334827169 None] attachment_update completed successfully.
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d9b572-c37e-4490-87f8-e5afe9c05f29]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:50 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.387s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:10:50 devstack sudo[96917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e
Nov 02 10:10:50 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2f24d1c2-84f7-447b-b020-c6116b0eec9d tempest-GroupSnapshotsTest-262746101 None] Delete group completed successfully.
Nov 02 10:10:50 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e" returned: 0 in 0.500s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:50 devstack sudo[97338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19
Nov 02 10:10:50 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:51 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19" returned: 0 in 0.554s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:51 devstack sudo[97344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19
Nov 02 10:10:51 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:51 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.1e8d9b08-4166-44f2-ba4f-262e3a4c3c19" returned: 0 in 0.415s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb9375e-5e08-451a-825a-2a9f433d2f8e /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 -F qcow2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:51 devstack sudo[97347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb9375e-5e08-451a-825a-2a9f433d2f8e /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 -F qcow2
Nov 02 10:10:51 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:52 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feb9375e-5e08-451a-825a-2a9f433d2f8e /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 -F qcow2" returned: 0 in 0.662s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-1e8d9b08-4166-44f2-ba4f-262e3a4c3c19" released by "_delete_snapshot" :: held 4.713s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-feb9375e-5e08-451a-825a-2a9f433d2f8e" released by "delete_snapshot" :: held 4.743s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:52 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=152,cinder:INSERT=34,cinder:UPDATE=115,cinder:DELETE=5 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:10:52 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Created reservations ['b19547f1-a464-4aec-bbd6-f54031b86dca', '8d007679-aa42-4e76-9c42-12c0d84fa0d8', '860390c3-2e5d-47e1-8a01-5c3833a55cdc', '5dc9bc8c-1b80-454b-82ae-675d9df665e4'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Delete snapshot completed successfully.
Nov 02 10:10:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-1e8d9b08-4166-44f2-ba4f-262e3a4c3c19-delete_snapshot" released by "delete_snapshot" :: held 5.152s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-7ed94706-2109-4f3d-94d1-40b277fa1a87-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-7ed94706-2109-4f3d-94d1-40b277fa1a87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-quobyte-feb9375e-5e08-451a-825a-2a9f433d2f8e" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-feb9375e-5e08-451a-825a-2a9f433d2f8e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-quobyte-7ed94706-2109-4f3d-94d1-40b277fa1a87" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-7ed94706-2109-4f3d-94d1-40b277fa1a87" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Deleting offline snapshot 7ed94706-2109-4f3d-94d1-40b277fa1a87 of volume feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] snapshot_file for this snap is: volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bff400d-cb73-42a8-b315-c0e27d7b4675]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:53 devstack sudo[97363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87
Nov 02 10:10:53 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:53 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-4dd7839f-d46c-43aa-b980-e026a160bb49 req-04dee6d8-85cf-4b35-9515-e89042449d24 tempest-AttachVolumeNegativeTest-1334827169 None] Terminate volume connection completed successfully.
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-4dd7839f-d46c-43aa-b980-e026a160bb49 req-04dee6d8-85cf-4b35-9515-e89042449d24 tempest-AttachVolumeNegativeTest-1334827169 None] Deleting attachment fc6887fb-4631-494b-b5c2-bdec0c6fda80. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:10:53 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87" returned: 0 in 0.771s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feb9375e-5e08-451a-825a-2a9f433d2f8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf6a374-2e95-4d44-8932-a6b28921bc33]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:54 devstack sudo[97400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e
Nov 02 10:10:54 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:54 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e" returned: 0 in 0.545s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:54 devstack sudo[97405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87
Nov 02 10:10:54 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:55 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87" returned: 0 in 0.689s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:55 devstack sudo[97430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87
Nov 02 10:10:55 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:55 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e.7ed94706-2109-4f3d-94d1-40b277fa1a87" returned: 0 in 0.319s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-7ed94706-2109-4f3d-94d1-40b277fa1a87" released by "_delete_snapshot" :: held 2.509s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-feb9375e-5e08-451a-825a-2a9f433d2f8e" released by "delete_snapshot" :: held 2.547s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Created reservations ['30650017-84f3-4deb-ac57-f28f6b530233', 'b46a1148-f3c7-4620-9775-19358a43cdaa', '95b98032-f69d-4c3b-b3fa-a5b975fbe235', '46a30834-c8b0-401b-bb0c-4dbc51ecc91e'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:55 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Delete snapshot completed successfully.
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-7ed94706-2109-4f3d-94d1-40b277fa1a87-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Snapshots deleted, issuing volume delete {{(pid=87014) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-quobyte-feb9375e-5e08-451a-825a-2a9f433d2f8e" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-feb9375e-5e08-451a-825a-2a9f433d2f8e" acquired by "delete_volume" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c115a33-9c3e-4060-958a-1697114f1e6b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:10:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:56 devstack sudo[97435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e
Nov 02 10:10:56 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:56 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e" returned: 0 in 0.431s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:56 devstack sudo[97447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e
Nov 02 10:10:56 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:56 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-feb9375e-5e08-451a-825a-2a9f433d2f8e" returned: 0 in 0.325s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-feb9375e-5e08-451a-825a-2a9f433d2f8e" released by "delete_volume" :: held 0.859s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:56 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Created reservations ['16968b93-2a73-4b2b-b2a6-241b9ed00e04', '837f5bca-3cba-433f-a738-198622b1b12a', '13798d83-14fb-40f9-b791-f3a76eb42af7', '13ba1199-a91c-4bf4-b91e-19d33ec40770'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:10:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:10:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:10:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:10:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:10:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:10:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:10:56 devstack sudo[97452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:10:56 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:10:57 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root
Nov 02 10:10:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.388s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:10:57 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:10:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Deleted volume successfully.
Nov 02 10:10:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9c0774b2-246f-4118-ae6c-e97ea4e24798 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-feb9375e-5e08-451a-825a-2a9f433d2f8e-delete_volume" released by "delete_volume" :: held 9.745s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:10:59 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:10:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Flow 'volume_create_manager' (b36ade54-1f54-4b33-955f-b42e04a94603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:10:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ca918a-261a-40f2-8fc3-297b3f4ba708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ca918a-261a-40f2-8fc3-297b3f4ba708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-250223595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6ee1d5-89de-4af7-9c7d-abd89542ae1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31f350b2bed4f9e9def73d08878d94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:00Z,use_quota=True,user_id='3761154411934003b7faf34f1ab77783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f4e385-b11e-4f40-8311-9e3337433755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:10:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69f4e385-b11e-4f40-8311-9e3337433755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:10:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da1ff5a-d394-4f03-bed1-d4bd6e1db38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da1ff5a-d394-4f03-bed1-d4bd6e1db38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b6ee1d5-89de-4af7-9c7d-abd89542ae1b', 'volume_name': 'volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f255e521-a5b1-4a6a-9c27-6d191e78b6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f255e521-a5b1-4a6a-9c27-6d191e78b6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7debd3a-cb6f-4799-9e39-b905147260da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:00 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Volume 3b6ee1d5-89de-4af7-9c7d-abd89542ae1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b', 'volume_size': 1}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-250223595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6ee1d5-89de-4af7-9c7d-abd89542ae1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31f350b2bed4f9e9def73d08878d94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:00Z,use_quota=True,user_id='3761154411934003b7faf34f1ab77783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Creating volume 3b6ee1d5-89de-4af7-9c7d-abd89542ae1b {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:00 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:00 devstack sudo[97523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b 1073741824
Nov 02 10:11:00 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "cinder-e488e6c8-f598-4a8b-825f-9c09b7c8baf3-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-e488e6c8-f598-4a8b-825f-9c09b7c8baf3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "cinder-quobyte-e488e6c8-f598-4a8b-825f-9c09b7c8baf3" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-quobyte-e488e6c8-f598-4a8b-825f-9c09b7c8baf3" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[839dfb23-3e3a-47f2-bde4-c514dd3d91d0]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:00 devstack sudo[97528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3
Nov 02 10:11:00 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:01 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b 1073741824" returned: 0 in 0.938s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:01 devstack sudo[97531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b
Nov 02 10:11:01 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:01 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3" returned: 0 in 0.588s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:01 devstack sudo[97538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3
Nov 02 10:11:01 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:01 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" returned: 0 in 0.343s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7debd3a-cb6f-4799-9e39-b905147260da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d5386b-00eb-4ebc-9a2a-16aa4888b629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:01 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Volume volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b (3b6ee1d5-89de-4af7-9c7d-abd89542ae1b): created successfully
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d5386b-00eb-4ebc-9a2a-16aa4888b629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Flow 'volume_create_manager' (b36ade54-1f54-4b33-955f-b42e04a94603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9ea1cbd7-26ac-489a-acac-e2ea80b9e88c tempest-VolumesDeleteCascade-635963858 None] Created volume successfully.
Nov 02 10:11:01 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e488e6c8-f598-4a8b-825f-9c09b7c8baf3" returned: 0 in 0.418s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-quobyte-e488e6c8-f598-4a8b-825f-9c09b7c8baf3" released by "delete_volume" :: held 1.098s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:01 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Created reservations ['1a0b9a36-5853-48a0-ba34-abddd23c3897', '63bb3451-7a4b-4b17-9bd4-073489b3fb79', '0462563f-c483-4cbe-a7b1-4ab0c1288751', 'c583f996-ef54-4cae-95fd-cbf4d64e9ba2'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:02 devstack sudo[97541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:02 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] Creating offline snapshot 8962d07d-08b2-46b3-806e-0fa79c0e3f92 of volume 3b6ee1d5-89de-4af7-9c7d-abd89542ae1b {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c50e53-b0d9-42e6-bde9-05ebd2ee7056]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:02 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.462s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:02 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Deleted volume successfully.
Nov 02 10:11:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dafe168a-b1ad-49cf-afe8-be82db0b1449 tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-e488e6c8-f598-4a8b-825f-9c09b7c8baf3-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:02 devstack sudo[97544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b
Nov 02 10:11:02 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:03 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" returned: 0 in 0.822s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:03 devstack sudo[97549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92 1G
Nov 02 10:11:03 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "cinder-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (52dbc7d0-a004-4aa1-b9f0-41586870f153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b43b15-2398-488c-acdb-863e8177d499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b43b15-2398-488c-acdb-863e8177d499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1619746400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41be7636-788b-4d0c-8917-ab355e9166dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:03Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e037f080-6b50-403f-9fa1-bbe88857dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e037f080-6b50-403f-9fa1-bbe88857dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef33f68-a211-45e2-8501-4a679793ce38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef33f68-a211-45e2-8501-4a679793ce38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41be7636-788b-4d0c-8917-ab355e9166dc', 'volume_name': 'volume-41be7636-788b-4d0c-8917-ab355e9166dc', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c61047-0505-4672-aceb-1f313e210f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c61047-0505-4672-aceb-1f313e210f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e5c5a9-d226-4d38-9bfa-5aa890b3005b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:03 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Volume 41be7636-788b-4d0c-8917-ab355e9166dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41be7636-788b-4d0c-8917-ab355e9166dc', 'volume_size': 1}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "cinder-quobyte-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-quobyte-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9" acquired by "delete_volume" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7dc608-03cc-4945-8832-ce73de3f581b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:04 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92 1G" returned: 0 in 0.684s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:04 devstack sudo[97554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9
Nov 02 10:11:04 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:04 devstack sudo[97555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92
Nov 02 10:11:04 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:04 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9" returned: 0 in 0.665s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:04 devstack sudo[97566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9
Nov 02 10:11:04 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:04 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92" returned: 0 in 0.559s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:04 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92 is being set with open permissions: ugo+rw
Nov 02 10:11:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:04 devstack sudo[97569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92
Nov 02 10:11:04 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:04 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9" returned: 0 in 0.434s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-quobyte-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9" released by "delete_volume" :: held 1.162s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:04 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92" returned: 0 in 0.411s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Created reservations ['4ee7718d-e60f-4acb-b200-36720ff48a27', 'e0cbc7d9-a8ab-4831-9891-b240d90bd7f0', '83b06695-6ef4-4f29-aeee-cf9bf4d030a3', 'da4fc68c-65e9-4c7b-913a-50dffb39d650'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:05 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.info
Nov 02 10:11:05 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:05 devstack sudo[97576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:05 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:05 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.info" returned: 0 in 0.400s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:05 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.info is being set with open permissions: ugo+rw
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:05 devstack sudo[97579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.info
Nov 02 10:11:05 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:05 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.407s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:05 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Deleted volume successfully.
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ab29ada-f85d-4dbd-bb7a-9af0319284cc tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-9791b616-e6aa-4ed5-9052-cfc9b78fd8b9-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:05 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.info" returned: 0 in 0.427s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.514s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.168s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1619746400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41be7636-788b-4d0c-8917-ab355e9166dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:03Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Creating volume 41be7636-788b-4d0c-8917-ab355e9166dc {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:05 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:06 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc 1073741824
Nov 02 10:11:06 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:06 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f9b0bf08-2d7d-4ce7-bc72-8575bd36f85a tempest-VolumesDeleteCascade-635963858 None] Create snapshot completed successfully
Nov 02 10:11:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "cinder-31900756-f2ac-46aa-adc9-15d041f9f3c9-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-31900756-f2ac-46aa-adc9-15d041f9f3c9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "cinder-quobyte-31900756-f2ac-46aa-adc9-15d041f9f3c9" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-quobyte-31900756-f2ac-46aa-adc9-15d041f9f3c9" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6aff1a-40d9-45ab-9c57-104ab4b2f3e2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:06 devstack sudo[97587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9
Nov 02 10:11:06 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:06 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc 1073741824" returned: 0 in 0.690s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:06 devstack sudo[97593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc
Nov 02 10:11:06 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:06 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9" returned: 0 in 0.592s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:06 devstack sudo[97597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9
Nov 02 10:11:06 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:07 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc" returned: 0 in 0.439s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e5c5a9-d226-4d38-9bfa-5aa890b3005b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41be7636-788b-4d0c-8917-ab355e9166dc', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704671fd-6100-4ccc-a929-933cbb21bf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:07 devstack sudo[97600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:07 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:07 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Volume volume-41be7636-788b-4d0c-8917-ab355e9166dc (41be7636-788b-4d0c-8917-ab355e9166dc): created successfully
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704671fd-6100-4ccc-a929-933cbb21bf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (52dbc7d0-a004-4aa1-b9f0-41586870f153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e1decac8-d5db-4021-9c57-ad99b0483da1 tempest-VolumesActionsTest-673230849 None] Created volume successfully.
Nov 02 10:11:07 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-31900756-f2ac-46aa-adc9-15d041f9f3c9" returned: 0 in 0.663s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-quobyte-31900756-f2ac-46aa-adc9-15d041f9f3c9" released by "delete_volume" :: held 1.354s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Created reservations ['5085a817-165b-4eeb-b385-0e9764902861', '4efd384b-70ad-4e95-9446-a6785246d45c', 'c0bf1f2b-c22e-40aa-bcac-725cd0c18ef6', '26368f90-f629-45e6-ba24-ef7f2bf74bad'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:07 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.668s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3e74bad8-51a8-4f9f-b4a4-2f28bff7037a tempest-VolumesActionsTest-673230849 None] Acquiring lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc" by "attach_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3e74bad8-51a8-4f9f-b4a4-2f28bff7037a tempest-VolumesActionsTest-673230849 None] Lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc" acquired by "attach_volume" :: waited 0.064s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:08 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:08 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:08 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3e74bad8-51a8-4f9f-b4a4-2f28bff7037a tempest-VolumesActionsTest-673230849 None] Attaching volume 41be7636-788b-4d0c-8917-ab355e9166dc to instance 7c6d8a1f-b14d-46b5-98e7-c9f5bf828583 at mountpoint /dev/vdb on host None.
Nov 02 10:11:08 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3e74bad8-51a8-4f9f-b4a4-2f28bff7037a tempest-VolumesActionsTest-673230849 None] Attach volume completed successfully.
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3e74bad8-51a8-4f9f-b4a4-2f28bff7037a tempest-VolumesActionsTest-673230849 None] Lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc" released by "attach_volume" :: held 0.197s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Flow 'volume_create_manager' (a8a5b1fc-fdce-417c-8b33-cc9358e4147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93893cf-1a45-460f-9c57-647d0781f91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93893cf-1a45-460f-9c57-647d0781f91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1442956347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5a7656-aff4-4ddc-840b-56bc74de7446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31f350b2bed4f9e9def73d08878d94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8962d07d-08b2-46b3-806e-0fa79c0e3f92,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:08Z,use_quota=True,user_id='3761154411934003b7faf34f1ab77783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa70580-0107-478d-bec4-e1bb5375f5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa70580-0107-478d-bec4-e1bb5375f5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:08 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34ad2ba-0857-42ba-8a6e-8a048eefbaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34ad2ba-0857-42ba-8a6e-8a048eefbaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eb5a7656-aff4-4ddc-840b-56bc74de7446', 'volume_name': 'volume-eb5a7656-aff4-4ddc-840b-56bc74de7446', 'volume_size': 1, 'snapshot_id': '8962d07d-08b2-46b3-806e-0fa79c0e3f92'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ff0eaa-66a7-48fb-b76c-8e5ba52b9b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ff0eaa-66a7-48fb-b76c-8e5ba52b9b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7c0b77-158e-4aeb-af97-252e8c5ebb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:08 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Volume eb5a7656-aff4-4ddc-840b-56bc74de7446: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eb5a7656-aff4-4ddc-840b-56bc74de7446', 'volume_size': 1, 'snapshot_id': '8962d07d-08b2-46b3-806e-0fa79c0e3f92'}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.506s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:08 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Deleted volume successfully.
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-quobyte-8962d07d-08b2-46b3-806e-0fa79c0e3f92-eb5a7656-aff4-4ddc-840b-56bc74de7446" by "_create_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1de0d9a4-2a1c-4b21-acab-2bdccdef1b1c tempest-AttachVolumeNegativeTest-1334827169 None] Lock "cinder-31900756-f2ac-46aa-adc9-15d041f9f3c9-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-8962d07d-08b2-46b3-806e-0fa79c0e3f92-eb5a7656-aff4-4ddc-840b-56bc74de7446" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Creating volume eb5a7656-aff4-4ddc-840b-56bc74de7446 from snapshot 8962d07d-08b2-46b3-806e-0fa79c0e3f92 {{(pid=87014) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-quobyte-eb5a7656-aff4-4ddc-840b-56bc74de7446" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-eb5a7656-aff4-4ddc-840b-56bc74de7446" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] snapshot: 8962d07d-08b2-46b3-806e-0fa79c0e3f92, volume: eb5a7656-aff4-4ddc-840b-56bc74de7446,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a19784-4ec6-47b6-b652-f7e961cd6ab8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:08 devstack sudo[97608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92
Nov 02 10:11:08 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:09 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92" returned: 0 in 0.877s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:11:09 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aa4826-8500-4edc-8008-cf2658c63157]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:09 devstack sudo[97648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b
Nov 02 10:11:09 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:10 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" returned: 0 in 0.871s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:11:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:11:10 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446 not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:11:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:10 devstack sudo[97655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446
Nov 02 10:11:10 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ec886f6e-695d-4952-b5c4-00679a7b54c9 tempest-VolumesActionsTest-185638007 None] Terminate volume connection completed successfully.
Nov 02 10:11:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec886f6e-695d-4952-b5c4-00679a7b54c9 tempest-VolumesActionsTest-185638007 None] Acquiring lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc-detach_volume" by "detach_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec886f6e-695d-4952-b5c4-00679a7b54c9 tempest-VolumesActionsTest-185638007 None] Lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ec886f6e-695d-4952-b5c4-00679a7b54c9 tempest-VolumesActionsTest-185638007 None] Detaching volume 41be7636-788b-4d0c-8917-ab355e9166dc from instance 7c6d8a1f-b14d-46b5-98e7-c9f5bf828583.
Nov 02 10:11:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ec886f6e-695d-4952-b5c4-00679a7b54c9 tempest-VolumesActionsTest-185638007 None] Detach volume completed successfully.
Nov 02 10:11:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec886f6e-695d-4952-b5c4-00679a7b54c9 tempest-VolumesActionsTest-185638007 None] Lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-90156d3d-fe44-4726-8523-59ecd8c7dc5a tempest-VolumesActionsTest-673230849 None] Acquiring lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc-detach_volume" by "detach_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-90156d3d-fe44-4726-8523-59ecd8c7dc5a tempest-VolumesActionsTest-673230849 None] Lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:11 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-90156d3d-fe44-4726-8523-59ecd8c7dc5a tempest-VolumesActionsTest-673230849 None] Volume detach called, but volume not attached.
Nov 02 10:11:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-90156d3d-fe44-4726-8523-59ecd8c7dc5a tempest-VolumesActionsTest-673230849 None] Lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc-detach_volume" released by "detach_volume" :: held 0.053s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Acquiring lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Acquiring lock "cinder-quobyte-41be7636-788b-4d0c-8917-ab355e9166dc" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Lock "cinder-quobyte-41be7636-788b-4d0c-8917-ab355e9166dc" acquired by "delete_volume" :: waited 0.065s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:12 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af2c1c7-adc8-49fc-868e-08a1763ec674]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:12 devstack sudo[97668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc
Nov 02 10:11:12 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:13 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc" returned: 0 in 1.437s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:13 devstack sudo[97673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc
Nov 02 10:11:13 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:14 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-41be7636-788b-4d0c-8917-ab355e9166dc" returned: 0 in 1.157s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Lock "cinder-quobyte-41be7636-788b-4d0c-8917-ab355e9166dc" released by "delete_volume" :: held 2.712s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:15 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Created reservations ['7f36e741-f4ed-400d-bc65-331301d5685d', '24e37bae-00f4-4d0b-bd2e-e8b50faa5a0c', 'e76baf02-50c3-483d-a4a1-8efe6ad00d59', 'd939b081-be7b-4b49-9271-030a7d252d1e'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:15 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:15 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:15 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.544s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:15 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Deleted volume successfully.
Nov 02 10:11:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b4771cfd-f4bf-4e47-b971-ad500625e86f tempest-VolumesActionsTest-673230849 None] Lock "cinder-41be7636-788b-4d0c-8917-ab355e9166dc-delete_volume" released by "delete_volume" :: held 3.973s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:22 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446" returned: 0 in 11.559s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b, size 1024.00 MB, duration 11.56 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:11:22 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Converted 1024.00 MB image at 88.58 MB/s
Nov 02 10:11:22 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446 is being set with open permissions: ugo+rw
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:22 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446
Nov 02 10:11:22 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:22 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446" returned: 0 in 0.301s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-eb5a7656-aff4-4ddc-840b-56bc74de7446" released by "_copy_volume_from_snapshot" :: held 13.776s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=113,cinder:UPDATE=143,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-8962d07d-08b2-46b3-806e-0fa79c0e3f92-eb5a7656-aff4-4ddc-840b-56bc74de7446" released by "_create_volume_from_snapshot" :: held 13.882s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.923s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f7c0b77-158e-4aeb-af97-252e8c5ebb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5a7656-aff4-4ddc-840b-56bc74de7446', 'volume_size': 1, 'snapshot_id': '8962d07d-08b2-46b3-806e-0fa79c0e3f92'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1159f2-8253-40ab-995b-82d80e6ec730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:22 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Volume volume-eb5a7656-aff4-4ddc-840b-56bc74de7446 (eb5a7656-aff4-4ddc-840b-56bc74de7446): created successfully
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1159f2-8253-40ab-995b-82d80e6ec730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Flow 'volume_create_manager' (a8a5b1fc-fdce-417c-8b33-cc9358e4147a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-190ef9d3-5963-4c25-9ce6-2afaf88e001f tempest-VolumesDeleteCascade-635963858 None] Created volume successfully.
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Performing cascade delete. {{(pid=87014) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-8962d07d-08b2-46b3-806e-0fa79c0e3f92-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-8962d07d-08b2-46b3-806e-0fa79c0e3f92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-quobyte-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-quobyte-8962d07d-08b2-46b3-806e-0fa79c0e3f92" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-8962d07d-08b2-46b3-806e-0fa79c0e3f92" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Deleting offline snapshot 8962d07d-08b2-46b3-806e-0fa79c0e3f92 of volume 3b6ee1d5-89de-4af7-9c7d-abd89542ae1b {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:11:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] snapshot_file for this snap is: volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:11:23 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63dc3d2-967b-4f52-8d3d-5477c2f62180]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:23 devstack sudo[97727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92
Nov 02 10:11:23 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:23 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92" returned: 0 in 0.600s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:11:23 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac059a4d-1beb-4b6a-95b0-6e10e8aece78]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:23 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:23 devstack sudo[97735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b
Nov 02 10:11:23 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:23 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (3d6ecfbd-4822-431f-83cd-a29ac7977e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:23 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0aabf5-1024-4c3f-b48e-20ebd0519148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0aabf5-1024-4c3f-b48e-20ebd0519148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1241989116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a42368a4-fe37-492a-9de8-b8ee0d7c8c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:24Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5ac2c4-b38d-4671-88ad-c23f126247c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e5ac2c4-b38d-4671-88ad-c23f126247c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1897db88-6c65-4fdd-9f24-621cfd5fa119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1897db88-6c65-4fdd-9f24-621cfd5fa119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a42368a4-fe37-492a-9de8-b8ee0d7c8c76', 'volume_name': 'volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7eae84-b6ad-4700-a5bd-ef061b9a6d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7eae84-b6ad-4700-a5bd-ef061b9a6d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f181de-f8e1-4045-bad2-b3f7ad488dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:24 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Volume a42368a4-fe37-492a-9de8-b8ee0d7c8c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76', 'volume_size': 1}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1241989116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a42368a4-fe37-492a-9de8-b8ee0d7c8c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:24Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Creating volume a42368a4-fe37-492a-9de8-b8ee0d7c8c76 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:24 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:24 devstack sudo[97737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76 1073741824
Nov 02 10:11:24 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:24 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" returned: 0 in 0.705s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:24 devstack sudo[97745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92
Nov 02 10:11:24 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:24 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76 1073741824" returned: 0 in 0.585s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:24 devstack sudo[97750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76
Nov 02 10:11:24 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:24 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92" returned: 0 in 0.524s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:24 devstack sudo[97753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92
Nov 02 10:11:24 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:25 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76" returned: 0 in 0.435s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f181de-f8e1-4045-bad2-b3f7ad488dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac7e478-20d7-40de-920c-3d2302a04913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:25 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Volume volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76 (a42368a4-fe37-492a-9de8-b8ee0d7c8c76): created successfully
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac7e478-20d7-40de-920c-3d2302a04913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (3d6ecfbd-4822-431f-83cd-a29ac7977e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:25 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3e182f11-a587-4216-8493-4a1aa6f900ab tempest-VolumesActionsTest-673230849 None] Created volume successfully.
Nov 02 10:11:25 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b.8962d07d-08b2-46b3-806e-0fa79c0e3f92" returned: 0 in 0.338s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-8962d07d-08b2-46b3-806e-0fa79c0e3f92" released by "_delete_snapshot" :: held 2.346s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" released by "delete_snapshot" :: held 2.373s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Created reservations ['c1cc53a8-0178-47e7-a9bb-41b01f7200e2', '579636ec-9b13-4c48-aeef-ff447558fb21', '5d399dd7-17a6-4018-b95b-a061840a009c', 'b472880a-9c6a-448e-837f-223ff340c745'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:25 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Delete snapshot completed successfully.
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-8962d07d-08b2-46b3-806e-0fa79c0e3f92-delete_snapshot" released by "delete_snapshot" :: held 2.580s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Snapshots deleted, issuing volume delete {{(pid=87014) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-quobyte-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fc730b-e9e7-4461-a59c-0a65d1d32744]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:25 devstack sudo[97757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b
Nov 02 10:11:25 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:26 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" returned: 0 in 0.521s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:26 devstack sudo[97762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b
Nov 02 10:11:26 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Acquiring lock "cinder-a42368a4-fe37-492a-9de8-b8ee0d7c8c76-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Lock "cinder-a42368a4-fe37-492a-9de8-b8ee0d7c8c76-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Acquiring lock "cinder-quobyte-a42368a4-fe37-492a-9de8-b8ee0d7c8c76" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:26 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" returned: 0 in 0.364s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b" released by "delete_volume" :: held 0.983s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Lock "cinder-quobyte-a42368a4-fe37-492a-9de8-b8ee0d7c8c76" acquired by "delete_volume" :: waited 0.062s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6270e2c6-8b30-4172-a0ff-1a6151ecf72d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Created reservations ['9f06a430-712c-48ae-980e-3354abfdc5ba', '04ac675b-5fdc-48b9-9930-d929f30bc80f', '9635b1b7-5447-4072-abd6-458cff18861c', '6292c114-a491-4f3b-be50-692ce45b7c34'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:26 devstack sudo[97765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76
Nov 02 10:11:26 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:26 devstack sudo[97767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:26 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:27 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76" returned: 0 in 0.525s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:27 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76
Nov 02 10:11:27 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:27 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.489s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:27 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Deleted volume successfully.
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d453855-4fff-4655-95f3-395cc5402e5b tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-3b6ee1d5-89de-4af7-9c7d-abd89542ae1b-delete_volume" released by "delete_volume" :: held 4.521s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Flow 'volume_create_manager' (c2bcf512-dfbd-464c-988b-7c18b614afff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5626f82c-d3d4-4ffa-be89-d62368684971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:27 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a42368a4-fe37-492a-9de8-b8ee0d7c8c76" returned: 0 in 0.457s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5626f82c-d3d4-4ffa-be89-d62368684971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-270655540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebae979-1d97-47f1-acbd-97e8b1c5a80c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb9986e3caf41fca7dcfa0f4743696a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:27Z,use_quota=True,user_id='fb7a15e13b9c4de6ad5d5fe113f6d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4872530-20a2-4b03-8c89-ec4ec2db0cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4872530-20a2-4b03-8c89-ec4ec2db0cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd2a39e-12c3-4ff9-aa6c-6992a937cb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd2a39e-12c3-4ff9-aa6c-6992a937cb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cebae979-1d97-47f1-acbd-97e8b1c5a80c', 'volume_name': 'volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57d61d0-e772-4b77-861e-e59c2a4d39fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57d61d0-e772-4b77-861e-e59c2a4d39fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f35f5c-e914-478e-b6db-f0ef6677a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:27 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Volume cebae979-1d97-47f1-acbd-97e8b1c5a80c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c', 'volume_size': 1}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-270655540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebae979-1d97-47f1-acbd-97e8b1c5a80c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb9986e3caf41fca7dcfa0f4743696a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:27Z,use_quota=True,user_id='fb7a15e13b9c4de6ad5d5fe113f6d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Creating volume cebae979-1d97-47f1-acbd-97e8b1c5a80c {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:27 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-eb5a7656-aff4-4ddc-840b-56bc74de7446-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Lock "cinder-quobyte-a42368a4-fe37-492a-9de8-b8ee0d7c8c76" released by "delete_volume" :: held 1.144s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:27 devstack sudo[97776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c 1073741824
Nov 02 10:11:27 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-eb5a7656-aff4-4ddc-840b-56bc74de7446-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "cinder-quobyte-eb5a7656-aff4-4ddc-840b-56bc74de7446" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-eb5a7656-aff4-4ddc-840b-56bc74de7446" acquired by "delete_volume" :: waited 0.034s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Created reservations ['15fe5a3a-0046-4614-967f-94cc66384378', '6356f090-8fe9-4200-8457-28e92ae98f6f', 'af5384e0-467e-41a2-b89d-eee40d289e02', 'ddcf159a-a747-4c30-b0ec-d2228af58bec'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d41c6f-486f-439c-86e5-4ded64587656]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:27 devstack sudo[97780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:27 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:27 devstack sudo[97778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446
Nov 02 10:11:27 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:28 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c 1073741824" returned: 0 in 0.548s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:28 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.359s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:28 devstack sudo[97791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c
Nov 02 10:11:28 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:28 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Deleted volume successfully.
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c65def4a-35f3-4f00-b7cf-b4c806e21d6c tempest-VolumesActionsTest-185638007 None] Lock "cinder-a42368a4-fe37-492a-9de8-b8ee0d7c8c76-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:28 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446" returned: 0 in 0.536s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:28 devstack sudo[97793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446
Nov 02 10:11:28 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:28 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-65827a81-786d-401d-9f87-1da393077a9c tempest-GroupsTest-1048612815 None] Group tempest-Group1-851144579: creating
Nov 02 10:11:28 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c" returned: 0 in 0.309s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:28 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-65827a81-786d-401d-9f87-1da393077a9c tempest-GroupsTest-1048612815 None] Group tempest-Group1-851144579: created successfully
Nov 02 10:11:28 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-65827a81-786d-401d-9f87-1da393077a9c tempest-GroupsTest-1048612815 None] Create group completed successfully.
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f35f5c-e914-478e-b6db-f0ef6677a00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c13d7a-3d11-48f6-b033-fba373fcf33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:28 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Volume volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c (cebae979-1d97-47f1-acbd-97e8b1c5a80c): created successfully
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c13d7a-3d11-48f6-b033-fba373fcf33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Flow 'volume_create_manager' (c2bcf512-dfbd-464c-988b-7c18b614afff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:28 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fe5ab945-e178-4f77-b4a7-55e1c2d0d3c8 tempest-VolumesTestJSON-686293529 None] Created volume successfully.
Nov 02 10:11:28 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-eb5a7656-aff4-4ddc-840b-56bc74de7446" returned: 0 in 0.329s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-quobyte-eb5a7656-aff4-4ddc-840b-56bc74de7446" released by "delete_volume" :: held 0.918s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Created reservations ['876e8fba-faae-4272-b809-a38f839c3fb1', '4747209e-97d9-4fc8-a590-c67f853ce3d8', 'a958a6ba-240f-4099-862f-7c893078a471', '2afed6dd-80b7-477f-9a08-4c3ef0fef112'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:28 devstack sudo[97797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:28 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:29 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.288s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:29 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Deleted volume successfully.
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dfb6b38a-22f2-465f-96e0-f5a00e93aa76 tempest-VolumesDeleteCascade-635963858 None] Lock "cinder-eb5a7656-aff4-4ddc-840b-56bc74de7446-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (d622bfe8-da16-4db8-8178-f3f248b92dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb06604-da93-4fc7-a825-7a591ee64624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb06604-da93-4fc7-a825-7a591ee64624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1607078627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761a3ccb-cc20-4240-a464-95b33ad086ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:29Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a837d0eb-6dc3-472d-a600-cc745ed5d207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a837d0eb-6dc3-472d-a600-cc745ed5d207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb0d78f-9781-4bdd-90a5-f96b6ccacbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb0d78f-9781-4bdd-90a5-f96b6ccacbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '761a3ccb-cc20-4240-a464-95b33ad086ac', 'volume_name': 'volume-761a3ccb-cc20-4240-a464-95b33ad086ac', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9cae20-afe9-422d-bd05-c20a94a1351d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9cae20-afe9-422d-bd05-c20a94a1351d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c1497b-3dc1-4525-8b55-4106ad29b9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:29 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Volume 761a3ccb-cc20-4240-a464-95b33ad086ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-761a3ccb-cc20-4240-a464-95b33ad086ac', 'volume_size': 1}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1607078627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761a3ccb-cc20-4240-a464-95b33ad086ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:29Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Creating volume 761a3ccb-cc20-4240-a464-95b33ad086ac {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:29 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:29 devstack sudo[97800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac 1073741824
Nov 02 10:11:29 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:29 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-372a6c01-f2e0-4556-b7d2-fce1fa8236b9 tempest-GroupsTest-1048612815 None] Group tempest-Group2-40871540: creating
Nov 02 10:11:29 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-372a6c01-f2e0-4556-b7d2-fce1fa8236b9 tempest-GroupsTest-1048612815 None] Group tempest-Group2-40871540: created successfully
Nov 02 10:11:29 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-372a6c01-f2e0-4556-b7d2-fce1fa8236b9 tempest-GroupsTest-1048612815 None] Create group completed successfully.
Nov 02 10:11:30 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac 1073741824" returned: 0 in 0.779s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:30 devstack sudo[97806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac
Nov 02 10:11:30 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Flow 'volume_create_manager' (1fbcc0bb-fea8-4ce2-9028-df54df66a5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ff6c21-1d31-4380-8b2b-69bd1b22f5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ff6c21-1d31-4380-8b2b-69bd1b22f5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1155264156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f678dd87-4a0c-43a4-ae95-6e6774234644,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb9986e3caf41fca7dcfa0f4743696a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:30Z,use_quota=True,user_id='fb7a15e13b9c4de6ad5d5fe113f6d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab2ac82-a978-465e-a763-3a588523b213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab2ac82-a978-465e-a763-3a588523b213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07f0d90-a7fa-41d5-a907-967cf0134ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07f0d90-a7fa-41d5-a907-967cf0134ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f678dd87-4a0c-43a4-ae95-6e6774234644', 'volume_name': 'volume-f678dd87-4a0c-43a4-ae95-6e6774234644', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edaec7c-45b1-4506-8204-93630d590a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edaec7c-45b1-4506-8204-93630d590a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ecce7e-469f-41b9-b779-459d008e207e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:30 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:30 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Volume f678dd87-4a0c-43a4-ae95-6e6774234644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f678dd87-4a0c-43a4-ae95-6e6774234644', 'volume_size': 1}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac" returned: 0 in 0.275s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1155264156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f678dd87-4a0c-43a4-ae95-6e6774234644,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb9986e3caf41fca7dcfa0f4743696a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:30Z,use_quota=True,user_id='fb7a15e13b9c4de6ad5d5fe113f6d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Creating volume f678dd87-4a0c-43a4-ae95-6e6774234644 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:30 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c1497b-3dc1-4525-8b55-4106ad29b9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761a3ccb-cc20-4240-a464-95b33ad086ac', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:30 devstack sudo[97809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644 1073741824
Nov 02 10:11:30 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d73e5ea-1f0c-4f5a-b145-1a56ec0b4891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:30 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Volume volume-761a3ccb-cc20-4240-a464-95b33ad086ac (761a3ccb-cc20-4240-a464-95b33ad086ac): created successfully
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d73e5ea-1f0c-4f5a-b145-1a56ec0b4891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (d622bfe8-da16-4db8-8178-f3f248b92dbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:30 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c26b6d84-3674-4d32-b77a-db93f948dc07 tempest-VolumesActionsTest-673230849 None] Created volume successfully.
Nov 02 10:11:31 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644 1073741824" returned: 0 in 0.551s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:31 devstack sudo[97815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644
Nov 02 10:11:31 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:31 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644" returned: 0 in 0.402s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ecce7e-469f-41b9-b779-459d008e207e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f678dd87-4a0c-43a4-ae95-6e6774234644', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98368cf-3e18-4204-80a8-1bb3496dd18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Flow 'volume_create_manager' (b9b99734-88c0-41c8-b596-c7dd770625f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5244f841-7d3f-4007-92b6-e07b8f3911a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:31 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Volume volume-f678dd87-4a0c-43a4-ae95-6e6774234644 (f678dd87-4a0c-43a4-ae95-6e6774234644): created successfully
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98368cf-3e18-4204-80a8-1bb3496dd18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Flow 'volume_create_manager' (1fbcc0bb-fea8-4ce2-9028-df54df66a5b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5244f841-7d3f-4007-92b6-e07b8f3911a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1230860165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0b08cd0a-756a-42d2-a1c7-86fe4f104739,host='devstack@QuobyteHD#QuobyteHD',id=83a6d1c3-6346-4e23-9604-ce80547d6296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a3fcf44a23434aae7dd5e763749854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:32Z,use_quota=True,user_id='61cc835a82334aa99fbbc642bba2a285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39d1a4ec-c189-40d1-b9f5-67ab102db763),volume_type_id=39d1a4ec-c189-40d1-b9f5-67ab102db763)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff2be36-7fd8-4edf-b1de-d32b254bb7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff2be36-7fd8-4edf-b1de-d32b254bb7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d91c2f-2b1c-4e01-83f9-e9a7cc0e5297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d91c2f-2b1c-4e01-83f9-e9a7cc0e5297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a6d1c3-6346-4e23-9604-ce80547d6296', 'volume_name': 'volume-83a6d1c3-6346-4e23-9604-ce80547d6296', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f191a32-5e48-42fd-817c-042653361ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f191a32-5e48-42fd-817c-042653361ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c77f70e-927e-483e-afac-bf5e6f7d90fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:31 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Volume 83a6d1c3-6346-4e23-9604-ce80547d6296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a6d1c3-6346-4e23-9604-ce80547d6296', 'volume_size': 1}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0b08cd0a-756a-42d2-a1c7-86fe4f104739,created_at=2026-11-02T09:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1230860165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0b08cd0a-756a-42d2-a1c7-86fe4f104739,host='devstack@QuobyteHD#QuobyteHD',id=83a6d1c3-6346-4e23-9604-ce80547d6296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a3fcf44a23434aae7dd5e763749854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:32Z,use_quota=True,user_id='61cc835a82334aa99fbbc642bba2a285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39d1a4ec-c189-40d1-b9f5-67ab102db763),volume_type_id=39d1a4ec-c189-40d1-b9f5-67ab102db763)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Creating volume 83a6d1c3-6346-4e23-9604-ce80547d6296 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:31 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Acquiring lock "cinder-761a3ccb-cc20-4240-a464-95b33ad086ac-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:31 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-14133df1-6a69-417a-a820-6d49c0bfef5e tempest-VolumesTestJSON-686293529 None] Created volume successfully.
Nov 02 10:11:31 devstack sudo[97818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296 1073741824
Nov 02 10:11:31 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Lock "cinder-761a3ccb-cc20-4240-a464-95b33ad086ac-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Acquiring lock "cinder-quobyte-761a3ccb-cc20-4240-a464-95b33ad086ac" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Lock "cinder-quobyte-761a3ccb-cc20-4240-a464-95b33ad086ac" acquired by "delete_volume" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:32 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec7bfd4-d287-455c-9e2f-7fb973ab923d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:32 devstack sudo[97820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac
Nov 02 10:11:32 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:32 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296 1073741824" returned: 0 in 0.630s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:32 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296
Nov 02 10:11:32 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:32 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac" returned: 0 in 0.598s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:32 devstack sudo[97832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac
Nov 02 10:11:32 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:33 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296" returned: 0 in 0.422s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c77f70e-927e-483e-afac-bf5e6f7d90fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a6d1c3-6346-4e23-9604-ce80547d6296', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:33 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e89bca-db7a-4913-8811-75165844554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-761a3ccb-cc20-4240-a464-95b33ad086ac" returned: 0 in 0.391s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Lock "cinder-quobyte-761a3ccb-cc20-4240-a464-95b33ad086ac" released by "delete_volume" :: held 1.075s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:33 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Volume volume-83a6d1c3-6346-4e23-9604-ce80547d6296 (83a6d1c3-6346-4e23-9604-ce80547d6296): created successfully
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e89bca-db7a-4913-8811-75165844554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Flow 'volume_create_manager' (b9b99734-88c0-41c8-b596-c7dd770625f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:33 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5e78b158-a1db-4b01-b7cd-5e093fa0bd4a tempest-GroupsTest-1048612815 None] Created volume successfully.
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Created reservations ['298ef488-ed52-4df0-ac4b-4787130157f3', 'ea6c8d65-6e53-4a19-8222-3a737bf03fe3', 'f9279662-9934-4cb0-999b-30e95ece00b9', '2ff3835f-cc0c-4e2d-a1ca-6fd122dd2969'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:33 devstack sudo[97836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:33 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Flow 'volume_create_manager' (80db3d2a-495e-4f90-9fd5-26cd90e1512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3cc102-62c2-485f-ab7d-a1db9e93c616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3cc102-62c2-485f-ab7d-a1db9e93c616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-621298661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca554b4-586f-44c5-af9d-9fda3c0217ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb9986e3caf41fca7dcfa0f4743696a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:33Z,use_quota=True,user_id='fb7a15e13b9c4de6ad5d5fe113f6d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aefe26-3379-4d0c-b927-94a837e80e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aefe26-3379-4d0c-b927-94a837e80e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c244e131-f6f0-4bc9-b638-c4998e33244b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c244e131-f6f0-4bc9-b638-c4998e33244b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca554b4-586f-44c5-af9d-9fda3c0217ca', 'volume_name': 'volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abbe7c4-a2c8-458c-981d-42178d62175d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abbe7c4-a2c8-458c-981d-42178d62175d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec141ab-1d2e-446f-ab78-decc0cc400c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:33 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Volume 0ca554b4-586f-44c5-af9d-9fda3c0217ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca', 'volume_size': 1}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-621298661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca554b4-586f-44c5-af9d-9fda3c0217ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1cb9986e3caf41fca7dcfa0f4743696a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:33Z,use_quota=True,user_id='fb7a15e13b9c4de6ad5d5fe113f6d768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Creating volume 0ca554b4-586f-44c5-af9d-9fda3c0217ca {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:33 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:33 devstack sudo[97838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca 1073741824
Nov 02 10:11:33 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:33 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.281s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:33 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Deleted volume successfully.
Nov 02 10:11:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-49310b28-bb85-4c0c-854b-ca373a3ecc56 tempest-VolumesActionsTest-185638007 None] Lock "cinder-761a3ccb-cc20-4240-a464-95b33ad086ac-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:34 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca 1073741824" returned: 0 in 0.549s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:34 devstack sudo[97845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca
Nov 02 10:11:34 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:34 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca" returned: 0 in 0.329s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec141ab-1d2e-446f-ab78-decc0cc400c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99a1781-e900-4354-a0a6-ea362355ce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:34 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Volume volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca (0ca554b4-586f-44c5-af9d-9fda3c0217ca): created successfully
Nov 02 10:11:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99a1781-e900-4354-a0a6-ea362355ce67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Flow 'volume_create_manager' (80db3d2a-495e-4f90-9fd5-26cd90e1512a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:34 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ab8d1177-53f0-4b24-b05c-e74a33cb18ae tempest-VolumesTestJSON-686293529 None] Created volume successfully.
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (4a4562fd-6f30-4519-9c6e-a65763873643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc4a860-b0e7-41c0-9201-6652b6df7535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc4a860-b0e7-41c0-9201-6652b6df7535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1908736819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabe7e43-ce93-48f5-897d-31046617762b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:35Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a82b39d-9710-457e-9e19-d4bea1f42de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a82b39d-9710-457e-9e19-d4bea1f42de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946d5f5e-9dfc-46e8-843f-bbac5268a5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946d5f5e-9dfc-46e8-843f-bbac5268a5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aabe7e43-ce93-48f5-897d-31046617762b', 'volume_name': 'volume-aabe7e43-ce93-48f5-897d-31046617762b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8177e286-e941-408c-9c81-280927c1c2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8177e286-e941-408c-9c81-280927c1c2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35857bef-d1d1-4a67-ad45-edcb061564fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:35 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Volume aabe7e43-ce93-48f5-897d-31046617762b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aabe7e43-ce93-48f5-897d-31046617762b', 'volume_size': 1}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1908736819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aabe7e43-ce93-48f5-897d-31046617762b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:35Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Creating volume aabe7e43-ce93-48f5-897d-31046617762b {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:35 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:35 devstack sudo[97848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b 1073741824
Nov 02 10:11:35 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Acquiring lock "cinder-quobyte-83a6d1c3-6346-4e23-9604-ce80547d6296" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Lock "cinder-quobyte-83a6d1c3-6346-4e23-9604-ce80547d6296" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1b5036-8117-4d5a-9fcc-1a617ffcda55]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:35 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b 1073741824" returned: 0 in 0.700s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:36 devstack sudo[97855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b
Nov 02 10:11:36 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:36 devstack sudo[97854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296
Nov 02 10:11:36 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:36 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b" returned: 0 in 0.338s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:36 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296" returned: 0 in 0.480s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35857bef-d1d1-4a67-ad45-edcb061564fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aabe7e43-ce93-48f5-897d-31046617762b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67728911-0ad6-4d41-bb07-5dcdb7a5984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:36 devstack sudo[97863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296
Nov 02 10:11:36 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:36 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Volume volume-aabe7e43-ce93-48f5-897d-31046617762b (aabe7e43-ce93-48f5-897d-31046617762b): created successfully
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67728911-0ad6-4d41-bb07-5dcdb7a5984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (4a4562fd-6f30-4519-9c6e-a65763873643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-11535d2b-8990-425d-8711-9dd3e9985e89 tempest-VolumesActionsTest-673230849 None] Created volume successfully.
Nov 02 10:11:36 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-83a6d1c3-6346-4e23-9604-ce80547d6296" returned: 0 in 0.353s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Lock "cinder-quobyte-83a6d1c3-6346-4e23-9604-ce80547d6296" released by "delete_volume" :: held 0.918s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Created reservations ['b78935e0-9095-42b3-99c1-b3211794ebe0'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:36 devstack cinder-volume[87014]: WARNING cinder.quota [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1980875918 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1980875918, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:11:36 devstack cinder-volume[87014]: WARNING cinder.quota [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1980875918 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1980875918, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:11:36 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Created reservations ['4ab198e6-9466-4336-ab42-c0064a8327cb', '798665e8-c342-44c3-a8bc-9eca8c0a7a0d', '48ef7b29-cd8e-4255-9a1e-6790d629fd54', 'a9665f7f-8658-458a-b535-12e642166759'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:37 devstack sudo[97866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:37 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:37 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.357s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:37 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e981b841-39ae-4521-9e66-d60e5426eac1 tempest-GroupsTest-1048612815 None] Delete group completed successfully.
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Acquiring lock "cinder-0ca554b4-586f-44c5-af9d-9fda3c0217ca-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-ef9867ba-fc98-43e8-b63a-910079871bb4 tempest-GroupsTest-1048612815 None] Created reservations ['27dbb1c3-5c72-4869-990b-5b09290df23b'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Lock "cinder-0ca554b4-586f-44c5-af9d-9fda3c0217ca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Acquiring lock "cinder-aabe7e43-ce93-48f5-897d-31046617762b-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Acquiring lock "cinder-quobyte-0ca554b4-586f-44c5-af9d-9fda3c0217ca" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Lock "cinder-aabe7e43-ce93-48f5-897d-31046617762b-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ef9867ba-fc98-43e8-b63a-910079871bb4 tempest-GroupsTest-1048612815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ef9867ba-fc98-43e8-b63a-910079871bb4 tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ef9867ba-fc98-43e8-b63a-910079871bb4 tempest-GroupsTest-1048612815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ef9867ba-fc98-43e8-b63a-910079871bb4 tempest-GroupsTest-1048612815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ef9867ba-fc98-43e8-b63a-910079871bb4 tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ef9867ba-fc98-43e8-b63a-910079871bb4 tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Lock "cinder-quobyte-0ca554b4-586f-44c5-af9d-9fda3c0217ca" acquired by "delete_volume" :: waited 0.108s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:37 devstack sudo[97869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:37 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[99915556-58a5-4df6-9396-e4ef344b8dd0]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Acquiring lock "cinder-quobyte-aabe7e43-ce93-48f5-897d-31046617762b" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Lock "cinder-quobyte-aabe7e43-ce93-48f5-897d-31046617762b" acquired by "delete_volume" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b011011-46cb-4fd7-8c3c-a3528e6e9a9e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:37 devstack sudo[97871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca
Nov 02 10:11:37 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Flow 'volume_create_manager' (1d2550ee-b190-44ad-b165-b07a34158d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:38 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8baa70-0818-4c66-8d7d-93d77d710541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:38 devstack sudo[97873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b
Nov 02 10:11:38 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ef9867ba-fc98-43e8-b63a-910079871bb4 tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.451s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-ef9867ba-fc98-43e8-b63a-910079871bb4 tempest-GroupsTest-1048612815 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:38 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ef9867ba-fc98-43e8-b63a-910079871bb4 tempest-GroupsTest-1048612815 None] Delete group completed successfully.
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8baa70-0818-4c66-8d7d-93d77d710541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1817042617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6332f2d2-277f-493d-beea-f198b5bd2dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4891ee941a7442ba95eb73a91e89e4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:38Z,use_quota=True,user_id='c66dc80502dd40778370b77390e77767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98da8a98-41fe-43ba-b565-1d43ae523de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98da8a98-41fe-43ba-b565-1d43ae523de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c88a299-2166-4ef9-8916-507fb1765e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c88a299-2166-4ef9-8916-507fb1765e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6332f2d2-277f-493d-beea-f198b5bd2dcb', 'volume_name': 'volume-6332f2d2-277f-493d-beea-f198b5bd2dcb', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f312bf0-8baa-4425-9a20-ba66f4ccfe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f312bf0-8baa-4425-9a20-ba66f4ccfe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7ec59d-ac17-425d-b6b6-67d5b424ac45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:38 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Volume 6332f2d2-277f-493d-beea-f198b5bd2dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6332f2d2-277f-493d-beea-f198b5bd2dcb', 'volume_size': 1}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1817042617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6332f2d2-277f-493d-beea-f198b5bd2dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4891ee941a7442ba95eb73a91e89e4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:38Z,use_quota=True,user_id='c66dc80502dd40778370b77390e77767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Creating volume 6332f2d2-277f-493d-beea-f198b5bd2dcb {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:38 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:38 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca" returned: 0 in 0.478s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:38 devstack sudo[97880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb 1073741824
Nov 02 10:11:38 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:38 devstack sudo[97881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca
Nov 02 10:11:38 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:38 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b" returned: 0 in 0.541s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:38 devstack sudo[97889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b
Nov 02 10:11:38 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:38 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ca554b4-586f-44c5-af9d-9fda3c0217ca" returned: 0 in 0.309s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Lock "cinder-quobyte-0ca554b4-586f-44c5-af9d-9fda3c0217ca" released by "delete_volume" :: held 0.864s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Created reservations ['c5a9b751-6b54-4b4e-a5fd-630c9625cc71', '1817ae5c-355f-4348-9b94-6483813a54c2', 'aed895f5-795c-4c43-b150-b511ef698992', 'a73f4665-041f-4a63-a9d7-a59d83422fa1'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:38 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:38 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Acquiring lock "cinder-f678dd87-4a0c-43a4-ae95-6e6774234644-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb 1073741824" returned: 0 in 0.644s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aabe7e43-ce93-48f5-897d-31046617762b" returned: 0 in 0.401s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:38 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:38 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Lock "cinder-quobyte-aabe7e43-ce93-48f5-897d-31046617762b" released by "delete_volume" :: held 1.053s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Lock "cinder-f678dd87-4a0c-43a4-ae95-6e6774234644-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:39 devstack sudo[97896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb
Nov 02 10:11:39 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Acquiring lock "cinder-quobyte-f678dd87-4a0c-43a4-ae95-6e6774234644" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Lock "cinder-quobyte-f678dd87-4a0c-43a4-ae95-6e6774234644" acquired by "delete_volume" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Created reservations ['dfe6213f-912d-4e62-985a-aaf3877c5a11', 'c3781a45-bb33-48cb-aa9a-dedb86d4ec6a', 'a97022c5-0f72-462e-8842-8200679b2b1a', '0ca65847-7d47-4799-87cc-9c752a6f3602'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[697fb6db-a170-438a-9d9e-6bfa96d40007]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:39 devstack sudo[97898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644
Nov 02 10:11:39 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:39 devstack sudo[97900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:39 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:39 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.506s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Deleted volume successfully.
Nov 02 10:11:39 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4facd44d-7592-4572-8722-1909e9895fd5 tempest-VolumesTestJSON-686293529 None] Lock "cinder-0ca554b4-586f-44c5-af9d-9fda3c0217ca-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb" returned: 0 in 0.453s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7ec59d-ac17-425d-b6b6-67d5b424ac45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6332f2d2-277f-493d-beea-f198b5bd2dcb', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d04a4ab-f19f-42f5-bc3a-5fda0c3ec56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:39 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Volume volume-6332f2d2-277f-493d-beea-f198b5bd2dcb (6332f2d2-277f-493d-beea-f198b5bd2dcb): created successfully
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d04a4ab-f19f-42f5-bc3a-5fda0c3ec56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Flow 'volume_create_manager' (1d2550ee-b190-44ad-b165-b07a34158d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-148e463e-baef-4b72-81ad-cf4eecfc8a80 tempest-VolumesTransfersTest-2102035374 None] Created volume successfully.
Nov 02 10:11:39 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.312s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Deleted volume successfully.
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2e2cfbf-e0f7-4491-8295-3c86d1229481 tempest-VolumesActionsTest-185638007 None] Lock "cinder-aabe7e43-ce93-48f5-897d-31046617762b-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8ed70f24-f1b7-4084-a832-442bb454bff6 tempest-GroupsTest-1048612815 None] Group tempest-GroupsTest-Group-129633831: creating
Nov 02 10:11:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8ed70f24-f1b7-4084-a832-442bb454bff6 tempest-GroupsTest-1048612815 None] Group tempest-GroupsTest-Group-129633831: created successfully
Nov 02 10:11:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8ed70f24-f1b7-4084-a832-442bb454bff6 tempest-GroupsTest-1048612815 None] Create group completed successfully.
Nov 02 10:11:39 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644" returned: 0 in 0.649s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:39 devstack sudo[97908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644
Nov 02 10:11:39 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:40 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f678dd87-4a0c-43a4-ae95-6e6774234644" returned: 0 in 0.323s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Lock "cinder-quobyte-f678dd87-4a0c-43a4-ae95-6e6774234644" released by "delete_volume" :: held 1.048s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Created reservations ['864bb7c3-4275-420c-9649-341b94091008', '6e274f46-5824-4449-8eb8-759f4bb7ef92', '5ac9a100-d090-4cfb-ac05-3f76816a9f82', '5a28db2b-cb45-41c3-9f40-569137188704'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:40 devstack sudo[97912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:40 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:40 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (31c4ad87-8957-4fe1-a1f0-950917fbbff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303c2ef1-d191-49e9-a5a5-88ba65d10384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.399s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:40 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Deleted volume successfully.
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303c2ef1-d191-49e9-a5a5-88ba65d10384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-637727191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eca0bbe-9c92-48b6-8e12-37433dc90d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:41Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8f0236-7709-4c0d-800e-e5f385bf6783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8f0236-7709-4c0d-800e-e5f385bf6783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f91f36-4baa-4820-9d17-4e30551ea833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f91f36-4baa-4820-9d17-4e30551ea833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eca0bbe-9c92-48b6-8e12-37433dc90d3f', 'volume_name': 'volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d576f3-6d1e-4f3d-8290-b0abcd22d09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d576f3-6d1e-4f3d-8290-b0abcd22d09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437e9450-caed-4500-83f8-006f454472c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:40 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Volume 9eca0bbe-9c92-48b6-8e12-37433dc90d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f', 'volume_size': 1}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-637727191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eca0bbe-9c92-48b6-8e12-37433dc90d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:41Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Creating volume 9eca0bbe-9c92-48b6-8e12-37433dc90d3f {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:40 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e58257ec-acc1-4858-b0a5-ae1730978b4c tempest-VolumesTestJSON-686293529 None] Lock "cinder-f678dd87-4a0c-43a4-ae95-6e6774234644-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:40 devstack sudo[97915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f 1073741824
Nov 02 10:11:40 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9232c198-faf7-49a4-9d1e-b4545805ba20 tempest-VolumesTransfersTest-1384395192 None] Transfer volume completed successfully.
Nov 02 10:11:41 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f 1073741824" returned: 0 in 0.778s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Flow 'volume_create_manager' (9cb5cbc5-035b-4aa9-93ba-586a66ef1a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77cb7af-ccad-4dde-9344-fefe964c578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77cb7af-ccad-4dde-9344-fefe964c578a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1826567608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=545490a0-f46e-4484-8155-b1dd1eabbc62,host='devstack@QuobyteHD#QuobyteHD',id=8698bf9d-8038-4444-ba25-b2ed1c35b710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a3fcf44a23434aae7dd5e763749854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:42Z,use_quota=True,user_id='61cc835a82334aa99fbbc642bba2a285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fae2ec51-3595-4f13-8387-bc3a1e5e012d),volume_type_id=fae2ec51-3595-4f13-8387-bc3a1e5e012d)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f3f51c-1f86-4d36-8142-010603e32db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f3f51c-1f86-4d36-8142-010603e32db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302bce15-36c4-4f9e-b6e0-1979e87619e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302bce15-36c4-4f9e-b6e0-1979e87619e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8698bf9d-8038-4444-ba25-b2ed1c35b710', 'volume_name': 'volume-8698bf9d-8038-4444-ba25-b2ed1c35b710', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe08962e-e81f-44a7-95ed-925074812440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe08962e-e81f-44a7-95ed-925074812440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c678d4d4-5dcb-467e-b057-69d684c7a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:41 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Volume 8698bf9d-8038-4444-ba25-b2ed1c35b710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8698bf9d-8038-4444-ba25-b2ed1c35b710', 'volume_size': 1}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Acquiring lock "cinder-cebae979-1d97-47f1-acbd-97e8b1c5a80c-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:41 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f
Nov 02 10:11:41 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Lock "cinder-cebae979-1d97-47f1-acbd-97e8b1c5a80c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Acquiring lock "cinder-quobyte-cebae979-1d97-47f1-acbd-97e8b1c5a80c" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Lock "cinder-quobyte-cebae979-1d97-47f1-acbd-97e8b1c5a80c" acquired by "delete_volume" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0130d5b8-e4a2-4985-afc8-00464965e85e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:42 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f" returned: 0 in 0.325s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:42 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c
Nov 02 10:11:42 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.363s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=545490a0-f46e-4484-8155-b1dd1eabbc62,created_at=2026-11-02T09:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1826567608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=545490a0-f46e-4484-8155-b1dd1eabbc62,host='devstack@QuobyteHD#QuobyteHD',id=8698bf9d-8038-4444-ba25-b2ed1c35b710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a3fcf44a23434aae7dd5e763749854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:42Z,use_quota=True,user_id='61cc835a82334aa99fbbc642bba2a285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fae2ec51-3595-4f13-8387-bc3a1e5e012d),volume_type_id=fae2ec51-3595-4f13-8387-bc3a1e5e012d)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Creating volume 8698bf9d-8038-4444-ba25-b2ed1c35b710 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:42 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437e9450-caed-4500-83f8-006f454472c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf1c275-f646-496e-ae0b-54933da6b6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:42 devstack sudo[97926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710 1073741824
Nov 02 10:11:42 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:42 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Volume volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f (9eca0bbe-9c92-48b6-8e12-37433dc90d3f): created successfully
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf1c275-f646-496e-ae0b-54933da6b6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (31c4ad87-8957-4fe1-a1f0-950917fbbff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Acquiring lock "cinder-6332f2d2-277f-493d-beea-f198b5bd2dcb-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:42 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8156667e-2838-4e6f-a120-ec1b76115736 tempest-VolumesActionsTest-673230849 None] Created volume successfully.
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Lock "cinder-6332f2d2-277f-493d-beea-f198b5bd2dcb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Acquiring lock "cinder-quobyte-6332f2d2-277f-493d-beea-f198b5bd2dcb" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Lock "cinder-quobyte-6332f2d2-277f-493d-beea-f198b5bd2dcb" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[de83727b-c7f0-4272-9253-74e491956322]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:42 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c" returned: 0 in 0.534s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:42 devstack sudo[97935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c
Nov 02 10:11:42 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:42 devstack sudo[97933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb
Nov 02 10:11:42 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:42 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710 1073741824" returned: 0 in 0.562s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:42 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710
Nov 02 10:11:42 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:42 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cebae979-1d97-47f1-acbd-97e8b1c5a80c" returned: 0 in 0.345s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Lock "cinder-quobyte-cebae979-1d97-47f1-acbd-97e8b1c5a80c" released by "delete_volume" :: held 0.968s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:42 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Created reservations ['bab924b1-9dea-4eba-a290-a30a1752f753', 'd93fd06d-80ac-43fa-9e86-c371f38d0d0f', '0a11a332-a623-4086-9cc7-2198de971c0f', '6e46ac64-4ae6-435e-866d-463dea9d40f5'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:43 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb" returned: 0 in 0.657s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:43 devstack sudo[97946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb
Nov 02 10:11:43 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:43 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710" returned: 0 in 0.414s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c678d4d4-5dcb-467e-b057-69d684c7a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8698bf9d-8038-4444-ba25-b2ed1c35b710', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed618dc-253c-4583-9948-84addfca534e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Acquiring lock "cinder-9eca0bbe-9c92-48b6-8e12-37433dc90d3f-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:43 devstack sudo[97948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:43 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:43 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Volume volume-8698bf9d-8038-4444-ba25-b2ed1c35b710 (8698bf9d-8038-4444-ba25-b2ed1c35b710): created successfully
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed618dc-253c-4583-9948-84addfca534e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Flow 'volume_create_manager' (9cb5cbc5-035b-4aa9-93ba-586a66ef1a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Lock "cinder-9eca0bbe-9c92-48b6-8e12-37433dc90d3f-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:43 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-89915240-4177-4957-b542-fcdf5746d95c tempest-GroupsTest-1048612815 None] Created volume successfully.
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Acquiring lock "cinder-quobyte-9eca0bbe-9c92-48b6-8e12-37433dc90d3f" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Lock "cinder-quobyte-9eca0bbe-9c92-48b6-8e12-37433dc90d3f" acquired by "delete_volume" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:43 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6332f2d2-277f-493d-beea-f198b5bd2dcb" returned: 0 in 0.358s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Lock "cinder-quobyte-6332f2d2-277f-493d-beea-f198b5bd2dcb" released by "delete_volume" :: held 1.087s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e195b5c2-c5f1-4762-85ab-19e1ded1e0a7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Created reservations ['cf738b0c-4e7d-4ffa-ac24-8ebf1518c7ed', '81b19cdf-38b8-4df2-938b-ede3ea6d46e7', 'a53ffa8b-0a89-4d95-9dc3-bf1513168326', '63701018-9312-4ce1-821a-d7b4a668eb09'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:43 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.376s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:43 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Deleted volume successfully.
Nov 02 10:11:43 devstack sudo[97951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f
Nov 02 10:11:43 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0f17418d-9eb6-43cf-8069-f3d852b1c5fa tempest-VolumesTestJSON-686293529 None] Lock "cinder-cebae979-1d97-47f1-acbd-97e8b1c5a80c-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:43 devstack sudo[97954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:43 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:43 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.273s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:43 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Deleted volume successfully.
Nov 02 10:11:43 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f" returned: 0 in 0.525s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d794ce0-5fc2-4db8-b9c9-4af048002e5b tempest-VolumesTransfersTest-570904730 None] Lock "cinder-6332f2d2-277f-493d-beea-f198b5bd2dcb-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:43 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f
Nov 02 10:11:43 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:44 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9eca0bbe-9c92-48b6-8e12-37433dc90d3f" returned: 0 in 0.351s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Lock "cinder-quobyte-9eca0bbe-9c92-48b6-8e12-37433dc90d3f" released by "delete_volume" :: held 0.948s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:44 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Created reservations ['e8313ad5-fefa-4291-a260-c0af63763459', 'f6d5ea6a-559e-4eca-94ff-5127788283c4', '46787c87-20bb-43d4-9828-e69f62b87fd2', 'fbe943ba-8605-44de-af6f-296646c83aca'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:44 devstack sudo[97963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:44 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:45 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.495s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:45 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Deleted volume successfully.
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-791bce39-92a3-4b80-b6ba-b51422fb3854 tempest-VolumesActionsTest-185638007 None] Lock "cinder-9eca0bbe-9c92-48b6-8e12-37433dc90d3f-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Flow 'volume_create_manager' (13bc27af-5d21-49f1-a054-42de195653b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b3b01c-7ce3-466d-92dc-13a6a8d3a0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b3b01c-7ce3-466d-92dc-13a6a8d3a0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-915209754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=545490a0-f46e-4484-8155-b1dd1eabbc62,host='devstack@QuobyteHD#QuobyteHD',id=3251d19f-fd1b-4f63-84f7-ae09733d4423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a3fcf44a23434aae7dd5e763749854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:45Z,use_quota=True,user_id='61cc835a82334aa99fbbc642bba2a285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fae2ec51-3595-4f13-8387-bc3a1e5e012d),volume_type_id=fae2ec51-3595-4f13-8387-bc3a1e5e012d)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e9b219-9ea4-41c2-996f-3cb09fa1cd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e9b219-9ea4-41c2-996f-3cb09fa1cd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c48668-bc74-4afb-9d0f-da2ad7877b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c48668-bc74-4afb-9d0f-da2ad7877b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3251d19f-fd1b-4f63-84f7-ae09733d4423', 'volume_name': 'volume-3251d19f-fd1b-4f63-84f7-ae09733d4423', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4150055-dcf9-4e91-adfa-25958b6e0920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4150055-dcf9-4e91-adfa-25958b6e0920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60d6396-7ab8-44a8-a329-2321cfad9cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:45 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Volume 3251d19f-fd1b-4f63-84f7-ae09733d4423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3251d19f-fd1b-4f63-84f7-ae09733d4423', 'volume_size': 1}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=545490a0-f46e-4484-8155-b1dd1eabbc62,created_at=2026-11-02T09:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-915209754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=545490a0-f46e-4484-8155-b1dd1eabbc62,host='devstack@QuobyteHD#QuobyteHD',id=3251d19f-fd1b-4f63-84f7-ae09733d4423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94a3fcf44a23434aae7dd5e763749854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:45Z,use_quota=True,user_id='61cc835a82334aa99fbbc642bba2a285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fae2ec51-3595-4f13-8387-bc3a1e5e012d),volume_type_id=fae2ec51-3595-4f13-8387-bc3a1e5e012d)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Creating volume 3251d19f-fd1b-4f63-84f7-ae09733d4423 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:45 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:45 devstack sudo[97966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423 1073741824
Nov 02 10:11:45 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Flow 'volume_create_manager' (27c8af8f-c948-4322-8495-789d370ca241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a0ccdd-d415-42b8-a7bc-da248866f4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a0ccdd-d415-42b8-a7bc-da248866f4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-648013982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fa4db6-458e-4f91-a2d8-d41854f53d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4891ee941a7442ba95eb73a91e89e4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:45Z,use_quota=True,user_id='c66dc80502dd40778370b77390e77767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb7a7fd-3d0c-408a-817c-d01118524f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb7a7fd-3d0c-408a-817c-d01118524f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8124098-8599-43a2-a941-77821440981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8124098-8599-43a2-a941-77821440981e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10fa4db6-458e-4f91-a2d8-d41854f53d3e', 'volume_name': 'volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8abf205-0f4b-4bfb-bb27-f36b10c88633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8abf205-0f4b-4bfb-bb27-f36b10c88633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d80cb7b-3118-46ee-ae11-b95fd451bd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:45 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Volume 10fa4db6-458e-4f91-a2d8-d41854f53d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e', 'volume_size': 1}
Nov 02 10:11:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (70102e35-98e0-44f9-b0bc-3f00cc94c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183548bb-d828-4a5d-b2eb-58f22a69cc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183548bb-d828-4a5d-b2eb-58f22a69cc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1574869933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362f9efb-4f57-4e4d-b761-79584c4c5a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:46Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dd9a27-addd-4ac6-9f14-aa45d02b8ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:46 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77dd9a27-addd-4ac6-9f14-aa45d02b8ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05837a74-a836-4737-80e4-8cd42ba8c91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05837a74-a836-4737-80e4-8cd42ba8c91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '362f9efb-4f57-4e4d-b761-79584c4c5a9d', 'volume_name': 'volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f49c69-683c-4165-a7d5-22891300b8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f49c69-683c-4165-a7d5-22891300b8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604ad52a-e354-473b-8d08-75d57f8347c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Volume 362f9efb-4f57-4e4d-b761-79584c4c5a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d', 'volume_size': 1}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423 1073741824" returned: 0 in 0.897s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:46 devstack sudo[97973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423
Nov 02 10:11:46 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:46 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423" returned: 0 in 0.286s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.076s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-648013982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10fa4db6-458e-4f91-a2d8-d41854f53d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4891ee941a7442ba95eb73a91e89e4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:45Z,use_quota=True,user_id='c66dc80502dd40778370b77390e77767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Creating volume 10fa4db6-458e-4f91-a2d8-d41854f53d3e {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:46 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60d6396-7ab8-44a8-a329-2321cfad9cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3251d19f-fd1b-4f63-84f7-ae09733d4423', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:46 devstack sudo[97976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e 1073741824
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9fd0b5-7a02-4b45-9ac7-08dd53a9e162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:46 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Volume volume-3251d19f-fd1b-4f63-84f7-ae09733d4423 (3251d19f-fd1b-4f63-84f7-ae09733d4423): created successfully
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee9fd0b5-7a02-4b45-9ac7-08dd53a9e162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Flow 'volume_create_manager' (13bc27af-5d21-49f1-a054-42de195653b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:46 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-217e3753-1b5a-4e75-9894-533e48e5ab21 tempest-GroupsTest-1048612815 None] Created volume successfully.
Nov 02 10:11:47 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e 1073741824" returned: 0 in 0.614s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:47 devstack sudo[97982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e
Nov 02 10:11:47 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:47 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e" returned: 0 in 0.417s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.452s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1574869933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362f9efb-4f57-4e4d-b761-79584c4c5a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9be314c2784921a2265222964e6027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:46Z,use_quota=True,user_id='a25501009d674c39ae3e5bc5076131f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Creating volume 362f9efb-4f57-4e4d-b761-79584c4c5a9d {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:47 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-eb7cf783-4a0e-40d7-970d-bb4e8f82797f tempest-GroupsTest-1048612815 None] Update group completed successfully.
Nov 02 10:11:47 devstack sudo[97985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d 1073741824
Nov 02 10:11:47 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d80cb7b-3118-46ee-ae11-b95fd451bd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d878ab-21b9-4ae5-bdd9-9c97c5bf5ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:47 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Volume volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e (10fa4db6-458e-4f91-a2d8-d41854f53d3e): created successfully
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d878ab-21b9-4ae5-bdd9-9c97c5bf5ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Flow 'volume_create_manager' (27c8af8f-c948-4322-8495-789d370ca241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fbd79f15-1eca-4c49-a169-53e2676dfb10 tempest-VolumesTransfersTest-2102035374 None] Created volume successfully.
Nov 02 10:11:48 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d 1073741824" returned: 0 in 0.500s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:48 devstack sudo[97992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d
Nov 02 10:11:48 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:48 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d" returned: 0 in 0.306s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604ad52a-e354-473b-8d08-75d57f8347c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf182d4-25cd-4858-ba9c-be1c70c881f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:48 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Volume volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d (362f9efb-4f57-4e4d-b761-79584c4c5a9d): created successfully
Nov 02 10:11:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf182d4-25cd-4858-ba9c-be1c70c881f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Flow 'volume_create_manager' (70102e35-98e0-44f9-b0bc-3f00cc94c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b5829e51-cbfb-4786-9fc2-feea06bbed55 tempest-VolumesActionsTest-673230849 None] Created volume successfully.
Nov 02 10:11:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Acquiring lock "cinder-10fa4db6-458e-4f91-a2d8-d41854f53d3e-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Lock "cinder-10fa4db6-458e-4f91-a2d8-d41854f53d3e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Acquiring lock "cinder-quobyte-10fa4db6-458e-4f91-a2d8-d41854f53d3e" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Lock "cinder-quobyte-10fa4db6-458e-4f91-a2d8-d41854f53d3e" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:49 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7c58fb-85e0-4aeb-a415-38b1498b81a2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:49 devstack sudo[97995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e
Nov 02 10:11:49 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:49 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f0c40160-dfbe-4679-89c1-f5c46ea0ac23 tempest-GroupsTest-1048612815 None] Update group completed successfully.
Nov 02 10:11:49 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e" returned: 0 in 0.478s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:49 devstack sudo[98000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e
Nov 02 10:11:49 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:49 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10fa4db6-458e-4f91-a2d8-d41854f53d3e" returned: 0 in 0.287s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Lock "cinder-quobyte-10fa4db6-458e-4f91-a2d8-d41854f53d3e" released by "delete_volume" :: held 0.820s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:49 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Created reservations ['6af1e0ef-8532-4c11-a61e-ad0e59ef1297', '3af18944-3cc6-4e2a-81f4-6d05780a0725', '49129416-13f3-46b5-a4ce-f0d2601883f3', 'fd641624-b263-459f-ae83-35ce086d6d97'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:50 devstack sudo[98003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:50 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Acquiring lock "cinder-362f9efb-4f57-4e4d-b761-79584c4c5a9d-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Lock "cinder-362f9efb-4f57-4e4d-b761-79584c4c5a9d-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Acquiring lock "cinder-quobyte-362f9efb-4f57-4e4d-b761-79584c4c5a9d" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Lock "cinder-quobyte-362f9efb-4f57-4e4d-b761-79584c4c5a9d" acquired by "delete_volume" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[32218fc1-efc4-413c-9ce9-23bd88ff8132]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:50 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.386s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Deleted volume successfully.
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73eb99aa-2fc4-421d-bb1c-a5b0da5b8534 tempest-VolumesTransfersTest-570904730 None] Lock "cinder-10fa4db6-458e-4f91-a2d8-d41854f53d3e-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:50 devstack sudo[98006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d
Nov 02 10:11:50 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ec0016c7-a006-4fef-a7fb-dc9b85ae012f tempest-GroupsV314Test-1047180961 None] Group tempest-GroupsV314Test-Group-2055972893: creating
Nov 02 10:11:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ec0016c7-a006-4fef-a7fb-dc9b85ae012f tempest-GroupsV314Test-1047180961 None] Group tempest-GroupsV314Test-Group-2055972893: created successfully
Nov 02 10:11:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ec0016c7-a006-4fef-a7fb-dc9b85ae012f tempest-GroupsV314Test-1047180961 None] Create group completed successfully.
Nov 02 10:11:50 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d" returned: 0 in 0.525s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:50 devstack sudo[98011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d
Nov 02 10:11:50 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Acquiring lock "cinder-quobyte-3251d19f-fd1b-4f63-84f7-ae09733d4423" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Lock "cinder-quobyte-3251d19f-fd1b-4f63-84f7-ae09733d4423" acquired by "delete_volume" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:51 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-362f9efb-4f57-4e4d-b761-79584c4c5a9d" returned: 0 in 0.354s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b067c-8520-46d6-80f5-58444cc9ee00]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Lock "cinder-quobyte-362f9efb-4f57-4e4d-b761-79584c4c5a9d" released by "delete_volume" :: held 0.978s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Created reservations ['1fb4d36f-8f7a-44c9-94ec-8f1420e75fbd', '0e527c63-6adc-457d-991c-d3ca3ed47f53', '9e21b484-54f5-4332-a748-8fba60c56460', 'b89074d2-08b6-422d-ac33-5385e616827e'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:51 devstack sudo[98015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423
Nov 02 10:11:51 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:51 devstack sudo[98017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:51 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:51 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423" returned: 0 in 0.493s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:51 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.306s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:51 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Deleted volume successfully.
Nov 02 10:11:51 devstack sudo[98024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423
Nov 02 10:11:51 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-522f0b6c-bf2e-4577-b41c-cb437c99a158 tempest-VolumesActionsTest-673230849 None] Lock "cinder-362f9efb-4f57-4e4d-b761-79584c4c5a9d-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:52 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3251d19f-fd1b-4f63-84f7-ae09733d4423" returned: 0 in 0.339s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Lock "cinder-quobyte-3251d19f-fd1b-4f63-84f7-ae09733d4423" released by "delete_volume" :: held 0.886s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Acquiring lock "cinder-quobyte-8698bf9d-8038-4444-ba25-b2ed1c35b710" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Lock "cinder-quobyte-8698bf9d-8038-4444-ba25-b2ed1c35b710" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca44c5-8e2c-42ad-9e7c-26db8de1093c]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:52 devstack sudo[98027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710
Nov 02 10:11:52 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Flow 'volume_create_manager' (52163e14-7636-484a-a664-c9196af2d993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff2eb07-445c-4552-9d56-72dbc278fb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff2eb07-445c-4552-9d56-72dbc278fb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-353572354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dcab7bab-bd21-44e6-b265-72974b7a3622,host='devstack@QuobyteHD#QuobyteHD',id=48c6777a-4688-44de-9039-dc7ff214ca32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b95b2466b334fc4bcc362ab57483331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:52Z,use_quota=True,user_id='e51afa34548140af96f21bd3ea1547b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7e017f6-d7b6-46a7-b995-5555915f9843),volume_type_id=a7e017f6-d7b6-46a7-b995-5555915f9843)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc238954-a8f9-40d3-8199-8f88e8914dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc238954-a8f9-40d3-8199-8f88e8914dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18357ff6-da01-47f8-998b-92169a22f577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18357ff6-da01-47f8-998b-92169a22f577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c6777a-4688-44de-9039-dc7ff214ca32', 'volume_name': 'volume-48c6777a-4688-44de-9039-dc7ff214ca32', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895c0bbb-7bf1-41ae-be3e-8414d4bf327d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895c0bbb-7bf1-41ae-be3e-8414d4bf327d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013a76bd-0f58-42f6-8c93-92353cf7b716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:52 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Volume 48c6777a-4688-44de-9039-dc7ff214ca32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c6777a-4688-44de-9039-dc7ff214ca32', 'volume_size': 1}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dcab7bab-bd21-44e6-b265-72974b7a3622,created_at=2026-11-02T09:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-353572354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dcab7bab-bd21-44e6-b265-72974b7a3622,host='devstack@QuobyteHD#QuobyteHD',id=48c6777a-4688-44de-9039-dc7ff214ca32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b95b2466b334fc4bcc362ab57483331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:11:52Z,use_quota=True,user_id='e51afa34548140af96f21bd3ea1547b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7e017f6-d7b6-46a7-b995-5555915f9843),volume_type_id=a7e017f6-d7b6-46a7-b995-5555915f9843)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Creating volume 48c6777a-4688-44de-9039-dc7ff214ca32 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:11:52 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:52 devstack sudo[98029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 1073741824
Nov 02 10:11:52 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:52 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710" returned: 0 in 0.649s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:52 devstack sudo[98035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710
Nov 02 10:11:52 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:53 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8698bf9d-8038-4444-ba25-b2ed1c35b710" returned: 0 in 0.377s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Lock "cinder-quobyte-8698bf9d-8038-4444-ba25-b2ed1c35b710" released by "delete_volume" :: held 1.093s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=176,cinder:INSERT=55,cinder:UPDATE=223,cinder:DELETE=19 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:11:53 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 1073741824" returned: 0 in 0.615s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Created reservations ['2467d783-4885-4a5a-976d-e16c485b74fe'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:53 devstack sudo[98042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32
Nov 02 10:11:53 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:53 devstack cinder-volume[87014]: WARNING cinder.quota [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-105820097 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-105820097, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:11:53 devstack cinder-volume[87014]: WARNING cinder.quota [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-105820097 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-105820097, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Created reservations ['27695565-e836-40dd-a51e-b2b42a65e5bd', '70493f36-e84b-4cee-8080-29688e488a38', '4644a751-849c-47e1-942a-8f7dfd17645b', 'bdb07fe2-7487-478e-a34d-6cce3b079440'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Created reservations ['d0d60e75-d949-436b-8d55-0ee394656487', '4d893abf-360d-4ee9-a1ce-c85acaf1eb9f', 'b51bdbd3-7dc2-4c0a-948c-bb3d43b9afe2', 'bb9b3bf4-12d7-4d55-8dca-abc7487408ff'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:11:53 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32" returned: 0 in 0.411s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:53 devstack sudo[98045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:11:53 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013a76bd-0f58-42f6-8c93-92353cf7b716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c6777a-4688-44de-9039-dc7ff214ca32', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bb509b-2c0a-49dc-b63b-af5e626ff7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:11:53 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Volume volume-48c6777a-4688-44de-9039-dc7ff214ca32 (48c6777a-4688-44de-9039-dc7ff214ca32): created successfully
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bb509b-2c0a-49dc-b63b-af5e626ff7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:11:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Flow 'volume_create_manager' (52163e14-7636-484a-a664-c9196af2d993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:11:54 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-bcdcb77c-9ccc-4677-b4e8-eb8ba86fbeac tempest-GroupsV314Test-1047180961 None] Created volume successfully.
Nov 02 10:11:54 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.383s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:54 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:11:54 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-13d8dcb8-e47e-4eb8-802e-3bc162c86d3e tempest-GroupsTest-1048612815 None] Delete group completed successfully.
Nov 02 10:11:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:56 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Cloning volume 48c6777a-4688-44de-9039-dc7ff214ca32 to volume 73585c1c-b682-4238-b6fa-5f47f8d8ec6b
Nov 02 10:11:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Creating offline snapshot 4f22b27e-486d-4442-b727-e639799a66f0 of volume 48c6777a-4688-44de-9039-dc7ff214ca32 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:11:56 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[42286960-5641-471f-8447-632b45def527]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:56 devstack sudo[98055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32
Nov 02 10:11:56 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:56 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32" returned: 0 in 0.629s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:56 devstack sudo[98061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0 1G
Nov 02 10:11:56 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:57 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0 1G" returned: 0 in 0.645s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c6777a-4688-44de-9039-dc7ff214ca32 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:57 devstack sudo[98067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c6777a-4688-44de-9039-dc7ff214ca32 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0
Nov 02 10:11:57 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:57 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48c6777a-4688-44de-9039-dc7ff214ca32 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0" returned: 0 in 0.477s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:57 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0 is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:11:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:57 devstack sudo[98076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0
Nov 02 10:11:57 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:58 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0" returned: 0 in 0.383s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:58 devstack sudo[98080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.info
Nov 02 10:11:58 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:58 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.info" returned: 0 in 0.374s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:58 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:11:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:58 devstack sudo[98083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.info
Nov 02 10:11:58 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:59 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.info" returned: 0 in 0.369s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Acquiring lock "cinder-quobyte-73585c1c-b682-4238-b6fa-5f47f8d8ec6b" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Lock "cinder-quobyte-73585c1c-b682-4238-b6fa-5f47f8d8ec6b" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] snapshot: 4f22b27e-486d-4442-b727-e639799a66f0, volume: 73585c1c-b682-4238-b6fa-5f47f8d8ec6b,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7230b8-709e-4c2b-b6fe-df6a1a21d3e1]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:59 devstack sudo[98087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0
Nov 02 10:11:59 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:11:59 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0" returned: 0 in 0.428s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c6777a-4688-44de-9039-dc7ff214ca32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e4d293-2584-427d-8ba1-74164e784bb0]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:11:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:11:59 devstack sudo[98092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32
Nov 02 10:11:59 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:00 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32" returned: 0 in 0.497s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:00 devstack sudo[98098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b
Nov 02 10:12:00 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Flow 'volume_create_manager' (e35c997a-b3ff-4c1d-804e-80cecdca5c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c896133-001e-4ff7-a5c1-6788800701e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c896133-001e-4ff7-a5c1-6788800701e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1407122507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ef317d-3267-4061-bb8c-62f521b2a7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dc0f751385455e8cfd1332192e8e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:00Z,use_quota=True,user_id='356913ef727e41dfb223a50eab6ad3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe4e7f4-db23-4393-83ca-b95c9a786f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe4e7f4-db23-4393-83ca-b95c9a786f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2001908d-e876-40ad-953a-b8f614b3b958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2001908d-e876-40ad-953a-b8f614b3b958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ef317d-3267-4061-bb8c-62f521b2a7c0', 'volume_name': 'volume-71ef317d-3267-4061-bb8c-62f521b2a7c0', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61fc7bf-e5ee-45eb-b98d-284b099b9549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61fc7bf-e5ee-45eb-b98d-284b099b9549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca1b775-73a6-4835-b0ca-5912b5b74800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:00 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Volume 71ef317d-3267-4061-bb8c-62f521b2a7c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ef317d-3267-4061-bb8c-62f521b2a7c0', 'volume_size': 1}
Nov 02 10:12:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:07 devstack sudo[98115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:12:07 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:07 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.465s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:12:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:12:08 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b" returned: 0 in 8.036s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:08 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32, size 1024.00 MB, duration 8.04 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:12:08 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Converted 1024.00 MB image at 127.41 MB/s
Nov 02 10:12:08 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b is being set with open permissions: ugo+rw: NotImplementedError
Nov 02 10:12:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:08 devstack sudo[98119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b
Nov 02 10:12:08 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:08 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b" returned: 0 in 0.328s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Lock "cinder-quobyte-73585c1c-b682-4238-b6fa-5f47f8d8ec6b" released by "_copy_volume_from_snapshot" :: held 9.448s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Acquiring lock "cinder-quobyte-4f22b27e-486d-4442-b727-e639799a66f0" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Lock "cinder-quobyte-4f22b27e-486d-4442-b727-e639799a66f0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Deleting offline snapshot 4f22b27e-486d-4442-b727-e639799a66f0 of volume 48c6777a-4688-44de-9039-dc7ff214ca32 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:12:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] snapshot_file for this snap is: volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:12:08 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d9ae43-2848-4a82-86af-7939c250078e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:08 devstack sudo[98122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0
Nov 02 10:12:08 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:09 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0" returned: 0 in 0.369s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48c6777a-4688-44de-9039-dc7ff214ca32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:12:09 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db020cf-2d3d-4b45-b9fd-f16da7b4bce5]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:09 devstack sudo[98127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32
Nov 02 10:12:09 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:09 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32" returned: 0 in 0.674s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:09 devstack sudo[98134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0
Nov 02 10:12:09 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:10 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0" returned: 0 in 0.419s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:10 devstack sudo[98140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0
Nov 02 10:12:10 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:10 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32.4f22b27e-486d-4442-b727-e639799a66f0" returned: 0 in 0.309s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Lock "cinder-quobyte-4f22b27e-486d-4442-b727-e639799a66f0" released by "_delete_snapshot" :: held 1.895s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.541s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.867s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1407122507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ef317d-3267-4061-bb8c-62f521b2a7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dc0f751385455e8cfd1332192e8e4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:00Z,use_quota=True,user_id='356913ef727e41dfb223a50eab6ad3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Creating volume 71ef317d-3267-4061-bb8c-62f521b2a7c0 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:12:10 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:12:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:10 devstack sudo[98177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0 1073741824
Nov 02 10:12:10 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-eb2af305-e331-4111-9f69-5172c23c032a tempest-GroupsV314Test-1047180961 None] Create group from source-group-dcab7bab-bd21-44e6-b265-72974b7a3622 completed successfully.
Nov 02 10:12:11 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0 1073741824" returned: 0 in 0.621s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:11 devstack sudo[98185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0
Nov 02 10:12:11 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:11 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0" returned: 0 in 0.306s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca1b775-73a6-4835-b0ca-5912b5b74800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ef317d-3267-4061-bb8c-62f521b2a7c0', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c2e4a2-2059-47c0-b791-b184a91c818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Acquiring lock "cinder-quobyte-73585c1c-b682-4238-b6fa-5f47f8d8ec6b" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:11 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Volume volume-71ef317d-3267-4061-bb8c-62f521b2a7c0 (71ef317d-3267-4061-bb8c-62f521b2a7c0): created successfully
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c2e4a2-2059-47c0-b791-b184a91c818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Flow 'volume_create_manager' (e35c997a-b3ff-4c1d-804e-80cecdca5c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Lock "cinder-quobyte-73585c1c-b682-4238-b6fa-5f47f8d8ec6b" acquired by "delete_volume" :: waited 0.038s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:11 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0149adbb-91ef-46d5-a50e-8c4b16ed99d9 tempest-VolumesNegativeTest-2017989486 None] Created volume successfully.
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53cd6b9-851d-49cc-a221-456a83a0f28b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:11 devstack sudo[98189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b
Nov 02 10:12:11 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:12 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b" returned: 0 in 0.523s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:12 devstack sudo[98194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b
Nov 02 10:12:12 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:12 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73585c1c-b682-4238-b6fa-5f47f8d8ec6b" returned: 0 in 0.307s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Lock "cinder-quobyte-73585c1c-b682-4238-b6fa-5f47f8d8ec6b" released by "delete_volume" :: held 0.891s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Created reservations ['e5686dc0-ac44-4348-b4cd-406ebba29a14'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:12:12 devstack cinder-volume[87014]: WARNING cinder.quota [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1718959804 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1718959804, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:12:12 devstack cinder-volume[87014]: WARNING cinder.quota [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1718959804 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1718959804, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Created reservations ['4a0712b6-cae3-4579-a0aa-74d1edd52940', '87637213-5ddf-4f1d-9e29-bb60207cc124', 'c943b2c2-29f1-4b38-93bf-9aca076b3e59', '173c155e-2f3b-4f52-85c2-df40f6876012'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:12 devstack sudo[98197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:12:12 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:13 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.438s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:13 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:12:13 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1f734d06-91ad-4d96-8a2e-e97d954c1b24 tempest-GroupsV314Test-1047180961 None] Delete group completed successfully.
Nov 02 10:12:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Acquiring lock "cinder-quobyte-48c6777a-4688-44de-9039-dc7ff214ca32" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Lock "cinder-quobyte-48c6777a-4688-44de-9039-dc7ff214ca32" acquired by "delete_volume" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:14 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c7c60-9649-4ace-9a6e-5ddec43b94ba]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:14 devstack sudo[98203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32
Nov 02 10:12:14 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:15 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32" returned: 0 in 0.537s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:15 devstack sudo[98208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32
Nov 02 10:12:15 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:15 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-48c6777a-4688-44de-9039-dc7ff214ca32" returned: 0 in 0.372s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Lock "cinder-quobyte-48c6777a-4688-44de-9039-dc7ff214ca32" released by "delete_volume" :: held 1.021s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Created reservations ['0dad2ed9-ee0d-425f-be4f-78926862ea12'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Created reservations ['f4d141ab-3be3-4aab-b410-502523b54e0c', 'ef7850bd-9a88-4ad5-b1ff-f2d022000f44', '4db6cc70-a5cb-430a-8031-b028003d112c', '2b134cac-85dc-4f86-a902-20833b148cbf'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:15 devstack sudo[98211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:12:15 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:16 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.332s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:16 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:12:16 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d4f59154-31c5-4aeb-bcfa-ed2260334ae4 tempest-GroupsV314Test-1047180961 None] Delete group completed successfully.
Nov 02 10:12:25 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=38,cinder:INSERT=12,cinder:UPDATE=44,cinder:DELETE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:12:25 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:UPDATE=213,cinder:DELETE=11,cinder:SELECT=156,cinder:INSERT=43 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Flow 'volume_create_manager' (1e3faae9-c7a9-4840-bd43-eec773604207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5075e4f4-071c-4196-ac90-2374f20140f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5075e4f4-071c-4196-ac90-2374f20140f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-325204120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4a2745-2af9-4ef4-a4ea-66af7a245da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd5b7d1d0db4299b37524d25984d232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:29Z,use_quota=True,user_id='d1d1ec282b554a089b66e31bfa5ee596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c7d0c3-f837-43af-a624-519495eedf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c7d0c3-f837-43af-a624-519495eedf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d67bbd-2802-4e6f-9085-48c26e1a2fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d67bbd-2802-4e6f-9085-48c26e1a2fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4a2745-2af9-4ef4-a4ea-66af7a245da1', 'volume_name': 'volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd35c948-6903-4c6b-bd1b-c50ada828eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd35c948-6903-4c6b-bd1b-c50ada828eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e321b37-e348-48c0-b291-0a333a436a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:29 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Volume 7f4a2745-2af9-4ef4-a4ea-66af7a245da1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1', 'volume_size': 1}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-325204120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4a2745-2af9-4ef4-a4ea-66af7a245da1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd5b7d1d0db4299b37524d25984d232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:29Z,use_quota=True,user_id='d1d1ec282b554a089b66e31bfa5ee596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Creating volume 7f4a2745-2af9-4ef4-a4ea-66af7a245da1 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:12:29 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:29 devstack sudo[98327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 1073741824
Nov 02 10:12:29 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:29 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 1073741824" returned: 0 in 0.634s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:30 devstack sudo[98333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1
Nov 02 10:12:30 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:30 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1" returned: 0 in 0.376s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:12:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e321b37-e348-48c0-b291-0a333a436a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56335b04-1a44-4bc7-a85a-548efd10d7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:30 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Volume volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 (7f4a2745-2af9-4ef4-a4ea-66af7a245da1): created successfully
Nov 02 10:12:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56335b04-1a44-4bc7-a85a-548efd10d7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Flow 'volume_create_manager' (1e3faae9-c7a9-4840-bd43-eec773604207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:30 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-dadb4387-195e-4163-976a-ba57c9f7bc84 tempest-VolumesCloneTest-2146424942 None] Created volume successfully.
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Flow 'volume_create_manager' (125b9275-f7bd-429a-99cd-0248dfeef824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfdc265-75ac-4d7e-b12c-c602857d4430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfdc265-75ac-4d7e-b12c-c602857d4430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-338266816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c80bb8-9173-420f-ad2f-dc4bf5573943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd5b7d1d0db4299b37524d25984d232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=7f4a2745-2af9-4ef4-a4ea-66af7a245da1,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:32Z,use_quota=True,user_id='d1d1ec282b554a089b66e31bfa5ee596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae99df2-14af-44ef-b909-239723f29525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae99df2-14af-44ef-b909-239723f29525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcd5360-ae1c-402c-93e5-eac38b942d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcd5360-ae1c-402c-93e5-eac38b942d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '29c80bb8-9173-420f-ad2f-dc4bf5573943', 'volume_name': 'volume-29c80bb8-9173-420f-ad2f-dc4bf5573943', 'volume_size': 2, 'source_volid': '7f4a2745-2af9-4ef4-a4ea-66af7a245da1', 'source_volstatus': 'available'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2939984c-5b6c-4fe5-98f7-3912399108e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2939984c-5b6c-4fe5-98f7-3912399108e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1eae783-21be-4bae-9e68-6fa98555d8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:32 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Volume 29c80bb8-9173-420f-ad2f-dc4bf5573943: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-29c80bb8-9173-420f-ad2f-dc4bf5573943', 'volume_size': 2, 'source_volid': '7f4a2745-2af9-4ef4-a4ea-66af7a245da1', 'source_volstatus': 'available'}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:32 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Cloning volume 7f4a2745-2af9-4ef4-a4ea-66af7a245da1 to volume 29c80bb8-9173-420f-ad2f-dc4bf5573943
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Creating offline snapshot 9a55d053-2b9a-4e9e-ae84-59e7e69da5ca of volume 7f4a2745-2af9-4ef4-a4ea-66af7a245da1 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b8ac90-a244-4acd-b31e-cb3d5b823ff7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Flow 'volume_create_manager' (6d0c5c6c-d57a-499a-97d4-b4008029c31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad4144d-baa0-4e85-ac72-5b8e166631b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:32 devstack sudo[98337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1
Nov 02 10:12:32 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad4144d-baa0-4e85-ac72-5b8e166631b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1908704580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4149f6-d51e-4a7f-bd44-3eb269a09e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57c001b269c468d817a79d95e9e5fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:32Z,use_quota=True,user_id='63a9b37bb0254f44ab242130d3d50842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ba092c9-97ad-4beb-888f-60b551eb1866),volume_type_id=1ba092c9-97ad-4beb-888f-60b551eb1866)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2190d985-5290-4216-9592-921970a8e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2190d985-5290-4216-9592-921970a8e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33403216-2323-47ca-beae-eda5b5864b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33403216-2323-47ca-beae-eda5b5864b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4149f6-d51e-4a7f-bd44-3eb269a09e72', 'volume_name': 'volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921f353b-bb33-4a71-9760-68d0b830c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921f353b-bb33-4a71-9760-68d0b830c153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202b1197-8291-4105-99f0-357a400dba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:32 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Volume 2c4149f6-d51e-4a7f-bd44-3eb269a09e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72', 'volume_size': 1}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:32 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1" returned: 0 in 0.506s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:33 devstack sudo[98343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca 1G
Nov 02 10:12:33 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:33 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca 1G" returned: 0 in 0.608s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:33 devstack sudo[98349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca
Nov 02 10:12:33 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:33 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca" returned: 0 in 0.371s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:33 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca is being set with open permissions: ugo+rw
Nov 02 10:12:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:33 devstack sudo[98355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca
Nov 02 10:12:34 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:34 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca" returned: 0 in 0.299s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:34 devstack sudo[98358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.info
Nov 02 10:12:34 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:34 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.info" returned: 0 in 0.329s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:34 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.info is being set with open permissions: ugo+rw
Nov 02 10:12:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:34 devstack sudo[98361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.info
Nov 02 10:12:34 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:34 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.info" returned: 0 in 0.310s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Acquiring lock "cinder-quobyte-29c80bb8-9173-420f-ad2f-dc4bf5573943" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Lock "cinder-quobyte-29c80bb8-9173-420f-ad2f-dc4bf5573943" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] snapshot: 9a55d053-2b9a-4e9e-ae84-59e7e69da5ca, volume: 29c80bb8-9173-420f-ad2f-dc4bf5573943,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b3672a-edd9-4879-9926-93c6cebf3cc2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:35 devstack sudo[98364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca
Nov 02 10:12:35 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:35 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca" returned: 0 in 0.433s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aeb14c-1921-4a95-b257-099704d2f51e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:35 devstack sudo[98369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1
Nov 02 10:12:35 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:35 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1" returned: 0 in 0.460s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943 not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:12:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:36 devstack sudo[98374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943
Nov 02 10:12:36 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Flow 'volume_create_manager' (d3fd21d4-18b2-4b05-9069-02a33090da36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60839793-a0ce-4792-995b-971943116238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60839793-a0ce-4792-995b-971943116238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1797722006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0781bf42-61c8-4c28-b1ee-75dd816e66cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742df6eb1ef84daaab2680f596de6804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:38Z,use_quota=True,user_id='c0f39cb4f9a9489d89ca32fca5fa63ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f736b52c-8a5d-453c-88d5-314e12530928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f736b52c-8a5d-453c-88d5-314e12530928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a892ac3c-e7a2-41c3-af85-6cb260aa3d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a892ac3c-e7a2-41c3-af85-6cb260aa3d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0781bf42-61c8-4c28-b1ee-75dd816e66cd', 'volume_name': 'volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacda11d-b47f-446d-ac71-19bda31aa75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacda11d-b47f-446d-ac71-19bda31aa75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2a7aa5-6380-4b23-8678-0c437dac7dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:37 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Volume 0781bf42-61c8-4c28-b1ee-75dd816e66cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd', 'volume_size': 1}
Nov 02 10:12:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Acquiring lock "cinder-71ef317d-3267-4061-bb8c-62f521b2a7c0-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Lock "cinder-71ef317d-3267-4061-bb8c-62f521b2a7c0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Acquiring lock "cinder-quobyte-71ef317d-3267-4061-bb8c-62f521b2a7c0" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Lock "cinder-quobyte-71ef317d-3267-4061-bb8c-62f521b2a7c0" acquired by "delete_volume" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:40 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ddfa14-7eb8-41f7-a5a0-ae4b6519f1c7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:40 devstack sudo[98389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0
Nov 02 10:12:40 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:40 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0" returned: 0 in 0.607s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:41 devstack sudo[98394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0
Nov 02 10:12:41 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:41 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-71ef317d-3267-4061-bb8c-62f521b2a7c0" returned: 0 in 0.714s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Lock "cinder-quobyte-71ef317d-3267-4061-bb8c-62f521b2a7c0" released by "delete_volume" :: held 1.411s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:41 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Created reservations ['9cf02ee2-d1a8-4dcb-aa6f-82c5a3f6ae5c', 'cc48f0a4-4fe2-4740-aff7-f3a62da7d51e', '02d86cf5-de78-43cb-88d5-52f9a01a2077', '495d4f56-3b95-40cc-84ad-50352e2007e6'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:12:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:42 devstack sudo[98397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:12:42 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:42 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.418s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:42 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:12:42 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Deleted volume successfully.
Nov 02 10:12:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3c6f4a52-8b30-49bb-a4b9-1d303e80d99c tempest-VolumesNegativeTest-2017989486 None] Lock "cinder-71ef317d-3267-4061-bb8c-62f521b2a7c0-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:43 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943" returned: 0 in 7.826s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:43 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1, size 1024.00 MB, duration 7.83 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:12:43 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Converted 1024.00 MB image at 130.82 MB/s
Nov 02 10:12:43 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943 is being set with open permissions: ugo+rw
Nov 02 10:12:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:43 devstack sudo[98400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943
Nov 02 10:12:43 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:44 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943" returned: 0 in 0.280s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Lock "cinder-quobyte-29c80bb8-9173-420f-ad2f-dc4bf5573943" released by "_copy_volume_from_snapshot" :: held 9.103s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Acquiring lock "cinder-quobyte-9a55d053-2b9a-4e9e-ae84-59e7e69da5ca" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Lock "cinder-quobyte-9a55d053-2b9a-4e9e-ae84-59e7e69da5ca" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Deleting offline snapshot 9a55d053-2b9a-4e9e-ae84-59e7e69da5ca of volume 7f4a2745-2af9-4ef4-a4ea-66af7a245da1 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] snapshot_file for this snap is: volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d0f9ca-f33c-42d2-93db-c87aae4fe81c]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:44 devstack sudo[98403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca
Nov 02 10:12:44 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:44 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca" returned: 0 in 0.499s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34b6626-797a-45b5-b5aa-9069b3ae2258]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:44 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1
Nov 02 10:12:44 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:45 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1" returned: 0 in 0.632s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:45 devstack sudo[98413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca
Nov 02 10:12:45 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:45 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca" returned: 0 in 0.397s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:45 devstack sudo[98418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca
Nov 02 10:12:45 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:46 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1.9a55d053-2b9a-4e9e-ae84-59e7e69da5ca" returned: 0 in 0.276s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Lock "cinder-quobyte-9a55d053-2b9a-4e9e-ae84-59e7e69da5ca" released by "_delete_snapshot" :: held 1.926s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.716s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.447s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1908704580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4149f6-d51e-4a7f-bd44-3eb269a09e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57c001b269c468d817a79d95e9e5fdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:32Z,use_quota=True,user_id='63a9b37bb0254f44ab242130d3d50842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ba092c9-97ad-4beb-888f-60b551eb1866),volume_type_id=1ba092c9-97ad-4beb-888f-60b551eb1866)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Creating volume 2c4149f6-d51e-4a7f-bd44-3eb269a09e72 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:12:46 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1eae783-21be-4bae-9e68-6fa98555d8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c80bb8-9173-420f-ad2f-dc4bf5573943', 'volume_size': 2, 'source_volid': '7f4a2745-2af9-4ef4-a4ea-66af7a245da1', 'source_volstatus': 'available'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67291f3-7759-45d4-af56-5b3130dccaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:46 devstack sudo[98421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72 1073741824
Nov 02 10:12:46 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Volume volume-29c80bb8-9173-420f-ad2f-dc4bf5573943 (29c80bb8-9173-420f-ad2f-dc4bf5573943): created successfully
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67291f3-7759-45d4-af56-5b3130dccaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Flow 'volume_create_manager' (125b9275-f7bd-429a-99cd-0248dfeef824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:46 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c9547e8a-3541-49da-93f2-96b2634c27e3 tempest-VolumesCloneTest-2146424942 None] Created volume successfully.
Nov 02 10:12:46 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72 1073741824" returned: 0 in 0.600s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:46 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72
Nov 02 10:12:46 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Acquiring lock "cinder-29c80bb8-9173-420f-ad2f-dc4bf5573943-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Lock "cinder-29c80bb8-9173-420f-ad2f-dc4bf5573943-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:47 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72" returned: 0 in 0.368s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.278s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1797722006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0781bf42-61c8-4c28-b1ee-75dd816e66cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742df6eb1ef84daaab2680f596de6804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:38Z,use_quota=True,user_id='c0f39cb4f9a9489d89ca32fca5fa63ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Creating volume 0781bf42-61c8-4c28-b1ee-75dd816e66cd {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:12:47 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:47 devstack sudo[98431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd 1073741824
Nov 02 10:12:47 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202b1197-8291-4105-99f0-357a400dba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c5aa71-6101-4911-9bbc-282aca42cfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Acquiring lock "cinder-quobyte-29c80bb8-9173-420f-ad2f-dc4bf5573943" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:47 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Volume volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72 (2c4149f6-d51e-4a7f-bd44-3eb269a09e72): created successfully
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c5aa71-6101-4911-9bbc-282aca42cfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Flow 'volume_create_manager' (6d0c5c6c-d57a-499a-97d4-b4008029c31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Lock "cinder-quobyte-29c80bb8-9173-420f-ad2f-dc4bf5573943" acquired by "delete_volume" :: waited 0.035s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-36b691dc-90f1-4953-9f8f-f473d62eead2 tempest-VolumeTypesAccessTest-133783530 None] Created volume successfully.
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d832e-291e-4827-b025-7c4f29f1e391]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:47 devstack sudo[98433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943
Nov 02 10:12:47 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:47 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd 1073741824" returned: 0 in 0.522s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:47 devstack sudo[98442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd
Nov 02 10:12:47 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:47 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943" returned: 0 in 0.500s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:47 devstack sudo[98444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943
Nov 02 10:12:47 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Acquiring lock "cinder-2c4149f6-d51e-4a7f-bd44-3eb269a09e72-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Lock "cinder-2c4149f6-d51e-4a7f-bd44-3eb269a09e72-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Acquiring lock "cinder-quobyte-2c4149f6-d51e-4a7f-bd44-3eb269a09e72" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Lock "cinder-quobyte-2c4149f6-d51e-4a7f-bd44-3eb269a09e72" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa9d44-3926-41ce-b1a9-35461e6a3e26]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:48 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd" returned: 0 in 0.381s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:48 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-29c80bb8-9173-420f-ad2f-dc4bf5573943" returned: 0 in 0.325s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2a7aa5-6380-4b23-8678-0c437dac7dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e5783a-dd62-4d37-a835-825a0b4d6f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Lock "cinder-quobyte-29c80bb8-9173-420f-ad2f-dc4bf5573943" released by "delete_volume" :: held 0.910s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:48 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Volume volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd (0781bf42-61c8-4c28-b1ee-75dd816e66cd): created successfully
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e5783a-dd62-4d37-a835-825a0b4d6f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Flow 'volume_create_manager' (d3fd21d4-18b2-4b05-9069-02a33090da36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:48 devstack sudo[98447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72
Nov 02 10:12:48 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-355604d0-8119-421f-baa4-34867238d7a6 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Created volume successfully.
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Created reservations ['5dcc9315-28d3-4835-882e-5b9a680ed288', '233fb5b1-ed34-4909-aca4-a3022eb94b62', '3112b13c-5c90-4e10-9112-23413398d7cc', '47e65515-ec91-4c33-a157-07ec7a2b3379'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:48 devstack sudo[98451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:12:48 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:48 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72" returned: 0 in 0.454s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:48 devstack sudo[98456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72
Nov 02 10:12:48 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:48 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.279s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:12:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Deleted volume successfully.
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f661e30-d885-4f1f-84db-354709c2a1d8 tempest-VolumesCloneTest-2146424942 None] Lock "cinder-29c80bb8-9173-420f-ad2f-dc4bf5573943-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Acquiring lock "cinder-0781bf42-61c8-4c28-b1ee-75dd816e66cd-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:48 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2c4149f6-d51e-4a7f-bd44-3eb269a09e72" returned: 0 in 0.334s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "cinder-0781bf42-61c8-4c28-b1ee-75dd816e66cd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Lock "cinder-quobyte-2c4149f6-d51e-4a7f-bd44-3eb269a09e72" released by "delete_volume" :: held 0.849s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Acquiring lock "cinder-quobyte-0781bf42-61c8-4c28-b1ee-75dd816e66cd" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:48 devstack cinder-volume[87014]: WARNING cinder.quota [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-408205669 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-408205669, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:12:48 devstack cinder-volume[87014]: WARNING cinder.quota [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-408205669 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-408205669, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:12:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "cinder-quobyte-0781bf42-61c8-4c28-b1ee-75dd816e66cd" acquired by "delete_volume" :: waited 0.039s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Created reservations ['fab46684-d98c-4aca-849f-b18c26aabb0e', '1eac61a6-3643-4479-944d-2d09b9fdd946', 'bd6cd00f-2750-4529-be85-24a4a6603fc0', 'a4cabe6c-4023-4d12-9b3c-291277eaf362'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da33178-8ede-425a-92f1-1f6a1988bbc8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:49 devstack sudo[98460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd
Nov 02 10:12:49 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:49 devstack sudo[98461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:12:49 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:49 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.314s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:12:49 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Deleted volume successfully.
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d6944e28-d265-48e7-bc47-32c2176efac6 tempest-VolumeTypesAccessTest-133783530 None] Lock "cinder-2c4149f6-d51e-4a7f-bd44-3eb269a09e72-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:49 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd" returned: 0 in 0.540s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Acquiring lock "cinder-7f4a2745-2af9-4ef4-a4ea-66af7a245da1-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:49 devstack sudo[98468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Lock "cinder-7f4a2745-2af9-4ef4-a4ea-66af7a245da1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:49 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Acquiring lock "cinder-quobyte-7f4a2745-2af9-4ef4-a4ea-66af7a245da1" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Lock "cinder-quobyte-7f4a2745-2af9-4ef4-a4ea-66af7a245da1" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c996ee-5dd4-40c3-a779-ff9a7cb8b694]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:49 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0781bf42-61c8-4c28-b1ee-75dd816e66cd" returned: 0 in 0.345s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "cinder-quobyte-0781bf42-61c8-4c28-b1ee-75dd816e66cd" released by "delete_volume" :: held 0.958s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:49 devstack sudo[98470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1
Nov 02 10:12:49 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Created reservations ['9c75f12b-d6ad-4e95-aee8-5b978a157579', '4e446060-0b2e-4b6e-9e21-a61dbdd45177', 'a8144e17-59d4-4116-aea9-2b9c5ec1eeb5', '4dd4778b-32db-40e2-957c-3c27ebce30e1'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:50 devstack sudo[98475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:12:50 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:50 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1" returned: 0 in 0.540s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:50 devstack sudo[98478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1
Nov 02 10:12:50 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:50 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.391s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:12:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Deleted volume successfully.
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-04e92102-3ce8-4819-b1ab-743d62da0728 tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "cinder-0781bf42-61c8-4c28-b1ee-75dd816e66cd-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:50 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7f4a2745-2af9-4ef4-a4ea-66af7a245da1" returned: 0 in 0.432s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Lock "cinder-quobyte-7f4a2745-2af9-4ef4-a4ea-66af7a245da1" released by "delete_volume" :: held 1.090s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Created reservations ['386d7edd-3246-4d2d-be8b-0763505e6098', '536e79b0-2745-485c-ad64-fc55b7206308', 'e85739a0-cacf-417d-9b11-e0709a5a8e85', 'f9e8f52a-50cf-4bad-9305-39a7efd96d39'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:50 devstack sudo[98482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:12:50 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:51 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.297s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:51 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:12:51 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Deleted volume successfully.
Nov 02 10:12:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-152388ad-588f-4746-902a-fbee4c2b9c1d tempest-VolumesCloneTest-2146424942 None] Lock "cinder-7f4a2745-2af9-4ef4-a4ea-66af7a245da1-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Flow 'volume_create_manager' (2f7d7137-c1fd-4293-ad9d-ef947768a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b172348-2870-4b9f-8202-eca88de45d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b172348-2870-4b9f-8202-eca88de45d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2017547126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73554955-e061-402f-9f61-6e2c496bd03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742df6eb1ef84daaab2680f596de6804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:52Z,use_quota=True,user_id='c0f39cb4f9a9489d89ca32fca5fa63ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0875c7d-d49f-4550-ade9-f5d1d8e6a7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0875c7d-d49f-4550-ade9-f5d1d8e6a7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69285d4-566b-4746-88ea-31004fda1deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69285d4-566b-4746-88ea-31004fda1deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73554955-e061-402f-9f61-6e2c496bd03f', 'volume_name': 'volume-73554955-e061-402f-9f61-6e2c496bd03f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e32efe-32ac-4fb7-b127-7e4d69bc389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e32efe-32ac-4fb7-b127-7e4d69bc389b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ed1563-18f6-4a92-b1fa-3730312f549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:52 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Volume 73554955-e061-402f-9f61-6e2c496bd03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73554955-e061-402f-9f61-6e2c496bd03f', 'volume_size': 1}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2017547126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73554955-e061-402f-9f61-6e2c496bd03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742df6eb1ef84daaab2680f596de6804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:52Z,use_quota=True,user_id='c0f39cb4f9a9489d89ca32fca5fa63ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Creating volume 73554955-e061-402f-9f61-6e2c496bd03f {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:12:52 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:12:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:52 devstack sudo[98485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f 1073741824
Nov 02 10:12:52 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:53 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f 1073741824" returned: 0 in 0.795s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:53 devstack sudo[98491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f
Nov 02 10:12:53 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:53 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f" returned: 0 in 0.307s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:12:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ed1563-18f6-4a92-b1fa-3730312f549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73554955-e061-402f-9f61-6e2c496bd03f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54fb95a-e37b-4343-bba7-1f23c1d86652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:53 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Volume volume-73554955-e061-402f-9f61-6e2c496bd03f (73554955-e061-402f-9f61-6e2c496bd03f): created successfully
Nov 02 10:12:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54fb95a-e37b-4343-bba7-1f23c1d86652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Flow 'volume_create_manager' (2f7d7137-c1fd-4293-ad9d-ef947768a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:53 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-19b7aa4e-3632-4baa-b16d-78ca7350d85b tempest-VolumeQuotasAdminTestJSON-1637727566 None] Created volume successfully.
Nov 02 10:12:54 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-29fa659c-3a66-439c-986b-293c8e0705dc tempest-VolumeQuotasAdminTestJSON-746165098 None] Transfer volume completed successfully.
Nov 02 10:12:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Acquiring lock "cinder-73554955-e061-402f-9f61-6e2c496bd03f-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Lock "cinder-73554955-e061-402f-9f61-6e2c496bd03f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Acquiring lock "cinder-quobyte-73554955-e061-402f-9f61-6e2c496bd03f" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:12:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Lock "cinder-quobyte-73554955-e061-402f-9f61-6e2c496bd03f" acquired by "delete_volume" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:12:55 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[27abffb0-6cbf-4f88-8959-a682114ad1e2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:12:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:55 devstack sudo[98494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f
Nov 02 10:12:55 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:56 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f" returned: 0 in 0.574s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:56 devstack sudo[98506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f
Nov 02 10:12:56 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:56 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-73554955-e061-402f-9f61-6e2c496bd03f" returned: 0 in 0.411s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Lock "cinder-quobyte-73554955-e061-402f-9f61-6e2c496bd03f" released by "delete_volume" :: held 1.061s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:56 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Created reservations ['1076e30d-d83e-4974-9c32-418ee83f426a', '6dbd0f52-2ec7-4066-8ef3-0842c12a6b11', '8a9bc3e5-e99d-4b03-911c-ffaf064a4b4b', 'a79171c4-d585-4647-900c-b42c823a73c4'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:12:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:57 devstack sudo[98509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:12:57 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:57 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.395s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:57 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:12:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Deleted volume successfully.
Nov 02 10:12:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e5750d2a-267d-42c1-b227-cb0939104bdb tempest-VolumeQuotasAdminTestJSON-884930234 None] Lock "cinder-73554955-e061-402f-9f61-6e2c496bd03f-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:12:58 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Flow 'volume_create_manager' (ad8a12a7-896c-4796-a06b-5a2cf503179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8955815b-362f-4704-a3ac-b42e857a732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8955815b-362f-4704-a3ac-b42e857a732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-333141796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4fb75a-bdc5-4277-9edb-7d781a45a20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18433668c09d4437ae45da1af3716b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:59Z,use_quota=True,user_id='ace200faa32948e3a3d0f0cb3a6f170d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c6d61c-6a83-47bb-a1aa-b700feeeeeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c6d61c-6a83-47bb-a1aa-b700feeeeeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9731568d-4436-4752-9389-f97cf30996d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9731568d-4436-4752-9389-f97cf30996d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd4fb75a-bdc5-4277-9edb-7d781a45a20a', 'volume_name': 'volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f221ca-f766-4fcd-bf58-d92ac3b75da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f221ca-f766-4fcd-bf58-d92ac3b75da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ee88e1-206a-49f6-837b-88af66598d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:12:59 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Volume bd4fb75a-bdc5-4277-9edb-7d781a45a20a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a', 'volume_size': 1}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-333141796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4fb75a-bdc5-4277-9edb-7d781a45a20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18433668c09d4437ae45da1af3716b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:12:59Z,use_quota=True,user_id='ace200faa32948e3a3d0f0cb3a6f170d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Creating volume bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:12:59 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:59 devstack sudo[98513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a 1073741824
Nov 02 10:12:59 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:12:59 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a 1073741824" returned: 0 in 0.644s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:12:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:12:59 devstack sudo[98519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a
Nov 02 10:12:59 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:00 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" returned: 0 in 0.323s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:13:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ee88e1-206a-49f6-837b-88af66598d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db3eb8b-b88d-4046-a261-61d3599dea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:00 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Volume volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a (bd4fb75a-bdc5-4277-9edb-7d781a45a20a): created successfully
Nov 02 10:13:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db3eb8b-b88d-4046-a261-61d3599dea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Flow 'volume_create_manager' (ad8a12a7-896c-4796-a06b-5a2cf503179e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:00 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e0ba626c-4f5a-49fa-b910-6b4361a8fb7a tempest-VolumesSnapshotListTestJSON-1167191147 None] Created volume successfully.
Nov 02 10:13:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] Creating offline snapshot f218e69e-2c0b-4c06-8c20-9e71911468da of volume bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:13:01 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec9e00d-19d2-409b-81c9-dc89138f01f8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:01 devstack sudo[98523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a
Nov 02 10:13:01 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:02 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" returned: 0 in 0.627s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:02 devstack sudo[98528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da 1G
Nov 02 10:13:02 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Flow 'volume_create_manager' (d654bdae-fd19-4608-9848-913e40c3b80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61feaea1-368d-4f04-a6d9-3691cf2f2cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61feaea1-368d-4f04-a6d9-3691cf2f2cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1993526202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e34cb04-09d5-4441-9c74-e5b810374782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ccf3ef454048dc855f614c3d717a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:03Z,use_quota=True,user_id='3a37207a437e4250ad9d0c57fb0dfab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184e6131-2cff-4fd9-b8df-494faf29f5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184e6131-2cff-4fd9-b8df-494faf29f5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c9686f-09d0-47e7-ab5b-4ca3a28440d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c9686f-09d0-47e7-ab5b-4ca3a28440d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e34cb04-09d5-4441-9c74-e5b810374782', 'volume_name': 'volume-8e34cb04-09d5-4441-9c74-e5b810374782', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1ab672-638b-4148-a497-9225b206f700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1ab672-638b-4148-a497-9225b206f700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0d6c48-efc0-4823-acbd-c80226f80bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:02 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Volume 8e34cb04-09d5-4441-9c74-e5b810374782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e34cb04-09d5-4441-9c74-e5b810374782', 'volume_size': 1}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:02 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da 1G" returned: 0 in 0.702s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:02 devstack sudo[98534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da
Nov 02 10:13:02 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:03 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da" returned: 0 in 0.388s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:03 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da is being set with open permissions: ugo+rw
Nov 02 10:13:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:03 devstack sudo[98540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da
Nov 02 10:13:03 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:03 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da" returned: 0 in 0.303s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:03 devstack sudo[98543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.info
Nov 02 10:13:03 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:04 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.info" returned: 0 in 0.451s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:04 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.info is being set with open permissions: ugo+rw
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:04 devstack sudo[98546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.info
Nov 02 10:13:04 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:04 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.info" returned: 0 in 0.302s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.941s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1993526202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e34cb04-09d5-4441-9c74-e5b810374782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ccf3ef454048dc855f614c3d717a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:03Z,use_quota=True,user_id='3a37207a437e4250ad9d0c57fb0dfab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Creating volume 8e34cb04-09d5-4441-9c74-e5b810374782 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:13:04 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:04 devstack sudo[98549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782 1073741824
Nov 02 10:13:04 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:04 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-26c54695-255c-4740-90de-49ca6c480e35 tempest-VolumesSnapshotListTestJSON-1167191147 None] Create snapshot completed successfully
Nov 02 10:13:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:05 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782 1073741824" returned: 0 in 0.750s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:05 devstack sudo[98557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782
Nov 02 10:13:05 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:05 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782" returned: 0 in 0.293s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.518s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] Creating offline snapshot 35e30e6f-1490-4e24-811c-46f4dd80b201 of volume bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0d6c48-efc0-4823-acbd-c80226f80bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e34cb04-09d5-4441-9c74-e5b810374782', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0b72b2-be30-4798-a9b0-c74bb484cb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a5750a-4d72-47ba-a6da-416d24d5d438]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:05 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Volume volume-8e34cb04-09d5-4441-9c74-e5b810374782 (8e34cb04-09d5-4441-9c74-e5b810374782): created successfully
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0b72b2-be30-4798-a9b0-c74bb484cb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Flow 'volume_create_manager' (d654bdae-fd19-4608-9848-913e40c3b80d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:05 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c3131ca0-30fa-4ad4-a163-4659a20d4ef1 tempest-VolumesListAdminTestJSON-748484521 None] Created volume successfully.
Nov 02 10:13:05 devstack sudo[98560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da
Nov 02 10:13:05 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:06 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da" returned: 0 in 0.667s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:06 devstack sudo[98565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 1G
Nov 02 10:13:06 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Flow 'volume_create_manager' (c586d64a-cf77-42f5-9418-7f06d5789a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a40b433-a6c0-434a-8927-23a60c1ad50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a40b433-a6c0-434a-8927-23a60c1ad50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-299977704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c109d0f7-e004-43ae-aa01-67f8e49de533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ccf3ef454048dc855f614c3d717a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:07Z,use_quota=True,user_id='3a37207a437e4250ad9d0c57fb0dfab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39aa3ee0-d927-40e6-a121-8f8b595342bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39aa3ee0-d927-40e6-a121-8f8b595342bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34969e4a-4eb8-41d0-9ba2-3164a37748c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34969e4a-4eb8-41d0-9ba2-3164a37748c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c109d0f7-e004-43ae-aa01-67f8e49de533', 'volume_name': 'volume-c109d0f7-e004-43ae-aa01-67f8e49de533', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239047a3-55da-4cc9-acd3-e8796a08868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239047a3-55da-4cc9-acd3-e8796a08868d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff05153d-9912-4bb8-a60f-89b37a7ef882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:06 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Volume c109d0f7-e004-43ae-aa01-67f8e49de533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c109d0f7-e004-43ae-aa01-67f8e49de533', 'volume_size': 1}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:06 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 1G" returned: 0 in 0.669s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:07 devstack sudo[98571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201
Nov 02 10:13:07 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:07 devstack sudo[98575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:13:07 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:07 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201" returned: 0 in 0.373s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:07 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 is being set with open permissions: ugo+rw
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:07 devstack sudo[98578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201
Nov 02 10:13:07 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:07 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.401s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:13:07 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201" returned: 0 in 0.395s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-299977704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c109d0f7-e004-43ae-aa01-67f8e49de533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ccf3ef454048dc855f614c3d717a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:07Z,use_quota=True,user_id='3a37207a437e4250ad9d0c57fb0dfab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Creating volume c109d0f7-e004-43ae-aa01-67f8e49de533 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:13:07 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:13:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:07 devstack sudo[98582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533 1073741824
Nov 02 10:13:07 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5b195d14-dd93-414a-9061-6e9cbf31562d tempest-VolumesSnapshotListTestJSON-1167191147 None] Create snapshot completed successfully
Nov 02 10:13:08 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533 1073741824" returned: 0 in 0.646s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:08 devstack sudo[98589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533
Nov 02 10:13:08 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:08 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533" returned: 0 in 0.307s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.338s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] Creating offline snapshot f74f7435-610e-4636-907f-0f9f9030abb7 of volume bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff05153d-9912-4bb8-a60f-89b37a7ef882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c109d0f7-e004-43ae-aa01-67f8e49de533', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4d2124-019a-488e-8207-010ad97ac166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da873ee-e93b-477d-a26e-9d0ca9aaca74]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:09 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Volume volume-c109d0f7-e004-43ae-aa01-67f8e49de533 (c109d0f7-e004-43ae-aa01-67f8e49de533): created successfully
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4d2124-019a-488e-8207-010ad97ac166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Flow 'volume_create_manager' (c586d64a-cf77-42f5-9418-7f06d5789a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e3ab9a42-1133-40a1-94b8-2954e5a237e5 tempest-VolumesListAdminTestJSON-748484521 None] Created volume successfully.
Nov 02 10:13:09 devstack sudo[98592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201
Nov 02 10:13:09 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:09 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201" returned: 0 in 0.614s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:09 devstack sudo[98597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7 1G
Nov 02 10:13:09 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Flow 'volume_create_manager' (509c9663-b557-4a0a-b816-4ad91d87ed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1c1128-850e-441f-a113-7048cb39a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1c1128-850e-441f-a113-7048cb39a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1723664930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f060cc5d-f282-4f41-81eb-ffaf6200d531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1eaf6188364cd1a0d54cc7b8da639b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:10Z,use_quota=True,user_id='ad856c9d002147f68f96e475c95427fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549349a1-66ad-46e6-a207-1d944e55c533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549349a1-66ad-46e6-a207-1d944e55c533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8a89eb-72ef-4395-828d-ff6873a7e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:09 devstack cinder-volume[87014]: DEBUG cinder.image.glance [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Creating Keystone auth plugin from conf {{(pid=87014) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 02 10:13:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8a89eb-72ef-4395-828d-ff6873a7e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f060cc5d-f282-4f41-81eb-ffaf6200d531', 'volume_name': 'volume-f060cc5d-f282-4f41-81eb-ffaf6200d531', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0e7350>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:10 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60eccb72-2cb7-41e2-b434-ee09c1422176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60eccb72-2cb7-41e2-b434-ee09c1422176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd48e43-119b-4fee-8857-ff8305ec14cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:10 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Volume f060cc5d-f282-4f41-81eb-ffaf6200d531: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f060cc5d-f282-4f41-81eb-ffaf6200d531', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0e7350>}
Nov 02 10:13:10 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Trying to clone f060cc5d-f282-4f41-81eb-ffaf6200d531 from image c35ca8ac-fc2e-4930-9230-8b67e658a8ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]). {{(pid=87014) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 02 10:13:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7 1G" returned: 0 in 0.823s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:10 devstack sudo[98603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7
Nov 02 10:13:10 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:10 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7" returned: 0 in 0.494s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:10 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7 is being set with open permissions: ugo+rw
Nov 02 10:13:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:10 devstack sudo[98614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7
Nov 02 10:13:10 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 02 10:13:10 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:10 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Image download 20.69 MB at 20.69 MB/s
Nov 02 10:13:10 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Flow 'volume_create_manager' (b4b8a855-ef7d-46a3-8bbd-4846d7e9d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c96443-0165-4869-8a1b-dced3a7c92a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[46605fce-2046-4744-9f70-d01746da0890]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c96443-0165-4869-8a1b-dced3a7c92a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-631710060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ccf3ef454048dc855f614c3d717a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:11Z,use_quota=True,user_id='3a37207a437e4250ad9d0c57fb0dfab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d047802-298d-4397-9cb6-9d872ca63080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d047802-298d-4397-9cb6-9d872ca63080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c49d83d-9500-4350-9be2-bf7c53d9247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c49d83d-9500-4350-9be2-bf7c53d9247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd95e92ba-8f81-4ac5-846a-7d4fc9b40fbb', 'volume_name': 'volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcc53d1-6550-4759-b5e2-39337e2064ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcc53d1-6550-4759-b5e2-39337e2064ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f54c64-c95a-48c8-aa0f-4ac9618bca65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:11 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Volume d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb', 'volume_size': 1}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:11 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7" returned: 0 in 0.334s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:11 devstack sudo[98635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD
Nov 02 10:13:11 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-631710060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2ccf3ef454048dc855f614c3d717a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:11Z,use_quota=True,user_id='3a37207a437e4250ad9d0c57fb0dfab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Creating volume d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:13:11 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:11 devstack sudo[98653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb 1073741824
Nov 02 10:13:11 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:11 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-896f30c3-aa77-4955-b9a2-620778d978db tempest-VolumesSnapshotListTestJSON-1167191147 None] Create snapshot completed successfully
Nov 02 10:13:11 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Temporary image c35ca8ac-fc2e-4930-9230-8b67e658a8ae is fetched for user ad856c9d002147f68f96e475c95427fe. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eabfff3-349d-4443-a160-98b3183f670d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:11 devstack sudo[98663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD
Nov 02 10:13:11 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:12 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb 1073741824" returned: 0 in 0.771s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:12 devstack sudo[98667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb
Nov 02 10:13:12 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:12 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:12 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb" returned: 0 in 0.349s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1723664930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f060cc5d-f282-4f41-81eb-ffaf6200d531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1eaf6188364cd1a0d54cc7b8da639b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:10Z,use_quota=True,user_id='ad856c9d002147f68f96e475c95427fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Creating volume f060cc5d-f282-4f41-81eb-ffaf6200d531 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:13:12 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f54c64-c95a-48c8-aa0f-4ac9618bca65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:12 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 1073741824
Nov 02 10:13:12 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae45d674-81b8-4e79-9ded-44131d864bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:12 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Volume volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb (d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb): created successfully
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae45d674-81b8-4e79-9ded-44131d864bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Flow 'volume_create_manager' (b4b8a855-ef7d-46a3-8bbd-4846d7e9d16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:12 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-af4414b6-6c52-4e38-92b8-b659e2348932 tempest-VolumesListAdminTestJSON-748484521 None] Created volume successfully.
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "cinder-f74f7435-610e-4636-907f-0f9f9030abb7-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-f74f7435-610e-4636-907f-0f9f9030abb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "cinder-quobyte-f74f7435-610e-4636-907f-0f9f9030abb7" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-f74f7435-610e-4636-907f-0f9f9030abb7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Deleting offline snapshot f74f7435-610e-4636-907f-0f9f9030abb7 of volume bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:13:13 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] snapshot_file for this snap is: volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 1073741824" returned: 0 in 0.727s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a223815e-0a08-4ecb-8477-03e3d48ba01b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:13 devstack sudo[98678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531
Nov 02 10:13:13 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:13 devstack sudo[98677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7
Nov 02 10:13:13 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:13 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531" returned: 0 in 0.346s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Attempting download of c35ca8ac-fc2e-4930-9230-8b67e658a8ae ((None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}])) to volume f060cc5d-f282-4f41-81eb-ffaf6200d531. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d37284-6f9d-4959-8037-9f25fc45ee7f]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_snxkr9jk {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:13 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7" returned: 0 in 0.566s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[986448ec-e6e7-4634-abc1-b915917142a5]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:13 devstack sudo[98685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_snxkr9jk
Nov 02 10:13:13 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:14 devstack sudo[98686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201
Nov 02 10:13:14 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:14 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_snxkr9jk" returned: 0 in 0.428s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_snxkr9jk {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Flow 'volume_create_manager' (22ba6e0c-0bc6-4efe-985c-24a8e641f5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3120256e-c94d-4730-b444-f72e7d087158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:14 devstack sudo[98691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_snxkr9jk
Nov 02 10:13:14 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3120256e-c94d-4730-b444-f72e7d087158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f452da-dc39-4929-959f-454be79330be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ce1d0f3c51497486f79d008072f732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:14Z,use_quota=True,user_id='48169b54b70d4f4081e9ac7dc205c480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327e7e42-1ac4-46d0-a001-2a3aaa58840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327e7e42-1ac4-46d0-a001-2a3aaa58840b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e3269d-c5d9-4a97-ba35-c7e7ee55dc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e3269d-c5d9-4a97-ba35-c7e7ee55dc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f452da-dc39-4929-959f-454be79330be', 'volume_name': 'volume-46f452da-dc39-4929-959f-454be79330be', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67509712-d391-414f-9a58-7eb44b13159d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67509712-d391-414f-9a58-7eb44b13159d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5189a3-80b1-42ae-83ff-4a5883dff82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:14 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Volume 46f452da-dc39-4929-959f-454be79330be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f452da-dc39-4929-959f-454be79330be', 'volume_size': 1}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f452da-dc39-4929-959f-454be79330be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ce1d0f3c51497486f79d008072f732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:14Z,use_quota=True,user_id='48169b54b70d4f4081e9ac7dc205c480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Creating volume 46f452da-dc39-4929-959f-454be79330be {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:13:14 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:14 devstack sudo[98696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be 1073741824
Nov 02 10:13:14 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:14 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201" returned: 0 in 0.675s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:14 devstack sudo[98698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7
Nov 02 10:13:14 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:14 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_snxkr9jk" returned: 1 in 0.415s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_snxkr9jk' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de82b86-a352-40ba-9c6d-e11bcde82df2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:14 devstack sudo[98702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD
Nov 02 10:13:14 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:15 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] c35ca8ac-fc2e-4930-9230-8b67e658a8ae was qcow2, converting to qcow2 {{(pid=87014) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:15 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be 1073741824" returned: 0 in 0.678s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:15 devstack sudo[98717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531
Nov 02 10:13:15 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:15 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7" returned: 0 in 0.695s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:15 devstack sudo[98719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7
Nov 02 10:13:15 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:15 devstack sudo[98721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be
Nov 02 10:13:15 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:15 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f74f7435-610e-4636-907f-0f9f9030abb7" returned: 0 in 0.393s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:15 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be" returned: 0 in 0.388s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-f74f7435-610e-4636-907f-0f9f9030abb7" released by "_delete_snapshot" :: held 2.511s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" released by "delete_snapshot" :: held 2.551s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5189a3-80b1-42ae-83ff-4a5883dff82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f452da-dc39-4929-959f-454be79330be', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120d4ada-2eed-4cf5-9ed2-9583b922c770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:15 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Volume volume-46f452da-dc39-4929-959f-454be79330be (46f452da-dc39-4929-959f-454be79330be): created successfully
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120d4ada-2eed-4cf5-9ed2-9583b922c770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Flow 'volume_create_manager' (22ba6e0c-0bc6-4efe-985c-24a8e641f5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8aba96d5-3bd7-4360-bf33-5041baf39aaa tempest-VolumesListAdminTestJSON-147514520 None] Created volume successfully.
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Created reservations ['4d79f094-cfab-4e5f-aee0-c8866e56b99e', '6c767918-8ece-46ae-b032-9a1aa0e2fef2', '7c3694fb-439b-4d01-886e-00869a487096', 'fbf7baff-f0be-41ff-813d-e88c311fba36'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Delete snapshot completed successfully.
Nov 02 10:13:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f723983a-4291-4a20-85d3-89e241ffd6ea tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-f74f7435-610e-4636-907f-0f9f9030abb7-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "cinder-35e30e6f-1490-4e24-811c-46f4dd80b201-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-35e30e6f-1490-4e24-811c-46f4dd80b201-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Acquiring lock "cinder-46f452da-dc39-4929-959f-454be79330be-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "cinder-quobyte-35e30e6f-1490-4e24-811c-46f4dd80b201" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Lock "cinder-46f452da-dc39-4929-959f-454be79330be-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-35e30e6f-1490-4e24-811c-46f4dd80b201" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Deleting offline snapshot 35e30e6f-1490-4e24-811c-46f4dd80b201 of volume bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] snapshot_file for this snap is: volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d051fe-9fd1-467b-85d9-3f7f74037136]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Acquiring lock "cinder-quobyte-46f452da-dc39-4929-959f-454be79330be" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Lock "cinder-quobyte-46f452da-dc39-4929-959f-454be79330be" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "cinder-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5522d6c-d968-4ada-ab32-7ec6ab9ca9bc]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:16 devstack sudo[98732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201
Nov 02 10:13:16 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "cinder-quobyte-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-quobyte-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb" acquired by "delete_volume" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:16 devstack sudo[98733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be
Nov 02 10:13:16 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:17 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f42cad8-5d81-497f-8a28-0979e8bb2d93]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:17 devstack sudo[98736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb
Nov 02 10:13:17 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:17 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201" returned: 0 in 0.646s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:13:17 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e1fef5-39d0-42b5-8fa2-18c25140de23]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:17 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be" returned: 0 in 0.609s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:17 devstack sudo[98746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be
Nov 02 10:13:17 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:17 devstack sudo[98745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da
Nov 02 10:13:17 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:17 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb" returned: 0 in 0.653s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:17 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb
Nov 02 10:13:17 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:18 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da" returned: 0 in 0.648s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:18 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-46f452da-dc39-4929-959f-454be79330be" returned: 0 in 0.651s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:18 devstack sudo[98758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201
Nov 02 10:13:18 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Lock "cinder-quobyte-46f452da-dc39-4929-959f-454be79330be" released by "delete_volume" :: held 1.350s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:18 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531" returned: 0 in 3.018s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_78hy_25pdevstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:13:18 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Converted 112.00 MB image at 37.09 MB/s
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:18 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb" returned: 0 in 0.535s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:18 devstack sudo[98761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 1G
Nov 02 10:13:18 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-quobyte-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb" released by "delete_volume" :: held 1.297s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Created reservations ['2e736794-f656-4054-85ee-666288a068b9', '02ca2b0d-4209-4c87-9367-4750c48f50e6', '111c92be-a747-4028-a70e-a3b24e95cee3', '1dcd9da6-f9f8-4910-918c-94d524f20708'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Created reservations ['48494538-6735-4f67-84fd-e93fd878c8db', '37c31b0a-8ffa-4616-a895-4f5cd5c5cc6f', '4bb6efdb-3765-401c-a47e-243a8821d75e', '66c2e87d-6b77-48ce-8fae-0ee73b3ac249'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:18 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:13:18 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:18 devstack sudo[98769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:13:18 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:18 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201" returned: 0 in 0.624s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:18 devstack sudo[98771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201
Nov 02 10:13:18 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:18 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.585s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:13:19 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:19 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 1G" returned: 0 in 0.831s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Downloaded image c35ca8ac-fc2e-4930-9230-8b67e658a8ae ((None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}])) to volume f060cc5d-f282-4f41-81eb-ffaf6200d531 successfully. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Temporary image c35ca8ac-fc2e-4930-9230-8b67e658a8ae for user ad856c9d002147f68f96e475c95427fe is deleted. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Marking volume f060cc5d-f282-4f41-81eb-ffaf6200d531 as bootable. {{(pid=87014) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.439s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Deleted volume successfully.
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Copying metadata from image c35ca8ac-fc2e-4930-9230-8b67e658a8ae to f060cc5d-f282-4f41-81eb-ffaf6200d531. {{(pid=87014) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Creating volume glance metadata for volume f060cc5d-f282-4f41-81eb-ffaf6200d531 backed by image c35ca8ac-fc2e-4930-9230-8b67e658a8ae with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87014) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 02 10:13:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Deleted volume successfully.
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff3d5935-2dd8-4836-849d-9dc80f9d2e84 tempest-VolumesListAdminTestJSON-147514520 None] Lock "cinder-46f452da-dc39-4929-959f-454be79330be-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ccb85775-1a8d-42a3-9efe-908f5e790a8b tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-d95e92ba-8f81-4ac5-846a-7d4fc9b40fbb-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:19 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.35e30e6f-1490-4e24-811c-46f4dd80b201" returned: 0 in 0.503s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-35e30e6f-1490-4e24-811c-46f4dd80b201" released by "_delete_snapshot" :: held 2.586s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" released by "delete_snapshot" :: held 2.641s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd48e43-119b-4fee-8857-ff8305ec14cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f060cc5d-f282-4f41-81eb-ffaf6200d531', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0e7350>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7a36e6-f833-4c07-a3d2-f074119ecf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:19 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Volume volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 (f060cc5d-f282-4f41-81eb-ffaf6200d531): created successfully
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7a36e6-f833-4c07-a3d2-f074119ecf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Flow 'volume_create_manager' (509c9663-b557-4a0a-b816-4ad91d87ed89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "cinder-c109d0f7-e004-43ae-aa01-67f8e49de533-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ac0bd604-5bce-4783-ab82-ef0d59c480bf tempest-VolumesImageMetadata-400659627 None] Created volume successfully.
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-c109d0f7-e004-43ae-aa01-67f8e49de533-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "cinder-quobyte-c109d0f7-e004-43ae-aa01-67f8e49de533" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Created reservations ['9e18ea28-093a-44c6-bd37-fde1754945fc', 'e0eda7ca-e814-4fa2-858e-7dcc0306bb95', '51f22ab1-ca02-4d0a-895f-9d1d9acd49b4', '087cf686-52be-42f1-9e0d-9dffd6c65c47'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-quobyte-c109d0f7-e004-43ae-aa01-67f8e49de533" acquired by "delete_volume" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c027e23-8bc2-4e11-b187-d9bf3462f0f4]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Delete snapshot completed successfully.
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b57bebf6-fd60-461c-813b-ad8c7fb3f774 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-35e30e6f-1490-4e24-811c-46f4dd80b201-delete_snapshot" released by "delete_snapshot" :: held 3.039s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:19 devstack sudo[98782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533
Nov 02 10:13:19 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "cinder-f218e69e-2c0b-4c06-8c20-9e71911468da-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-f218e69e-2c0b-4c06-8c20-9e71911468da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" acquired by "delete_snapshot" :: waited 0.084s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "cinder-quobyte-f218e69e-2c0b-4c06-8c20-9e71911468da" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-f218e69e-2c0b-4c06-8c20-9e71911468da" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Deleting offline snapshot f218e69e-2c0b-4c06-8c20-9e71911468da of volume bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] snapshot_file for this snap is: volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[deafae08-3047-4082-a3fb-bf43bc0da89a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:20 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533" returned: 0 in 0.651s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:20 devstack sudo[98784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da
Nov 02 10:13:20 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:20 devstack sudo[98788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533
Nov 02 10:13:20 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Acquiring lock "cinder-f060cc5d-f282-4f41-81eb-ffaf6200d531-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Lock "cinder-f060cc5d-f282-4f41-81eb-ffaf6200d531-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Acquiring lock "cinder-quobyte-f060cc5d-f282-4f41-81eb-ffaf6200d531" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Lock "cinder-quobyte-f060cc5d-f282-4f41-81eb-ffaf6200d531" acquired by "delete_volume" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:20 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c109d0f7-e004-43ae-aa01-67f8e49de533" returned: 0 in 0.531s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-quobyte-c109d0f7-e004-43ae-aa01-67f8e49de533" released by "delete_volume" :: held 1.237s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc4fdf7-e416-4586-a27e-4bcd38efb923]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:20 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da" returned: 0 in 0.742s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[929693fa-d898-4c62-995e-144ad0cdc2dd]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:20 devstack sudo[98795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531
Nov 02 10:13:20 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:20 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Created reservations ['23903944-528b-4a37-84c1-c9ee99cff8e7', '47feae1d-9210-4616-9bd9-1fecac3653fa', 'bcbb2aee-18c1-44f8-a15b-07de8c76c72a', '7a8fe42a-dbed-408c-8bbd-bac14623a23b'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:20 devstack sudo[98796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a
Nov 02 10:13:20 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:21 devstack sudo[98799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:13:21 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:21 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531" returned: 0 in 0.513s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:21 devstack sudo[98805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531
Nov 02 10:13:21 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:21 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" returned: 0 in 0.597s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:21 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.363s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:21 devstack sudo[98812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:13:21 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:21 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Deleted volume successfully.
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f90ed6d7-5f59-43dd-acfb-fa244b697169 tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-c109d0f7-e004-43ae-aa01-67f8e49de533-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:21 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f060cc5d-f282-4f41-81eb-ffaf6200d531" returned: 0 in 0.310s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Lock "cinder-quobyte-f060cc5d-f282-4f41-81eb-ffaf6200d531" released by "delete_volume" :: held 0.888s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Created reservations ['c378c639-1b7c-441b-8852-b3eac77bdde9', '251032ab-d95a-4f39-b339-9c5c57e0ec21', 'aa461823-27db-4f24-a16e-dedbd1aac904', '9a07a7fa-8d51-4f7a-b338-724707a28a0b'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "cinder-8e34cb04-09d5-4441-9c74-e5b810374782-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-8e34cb04-09d5-4441-9c74-e5b810374782-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:21 devstack sudo[98818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:13:21 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "cinder-quobyte-8e34cb04-09d5-4441-9c74-e5b810374782" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-quobyte-8e34cb04-09d5-4441-9c74-e5b810374782" acquired by "delete_volume" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:22 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da" returned: 0 in 0.682s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad197bb-4ba4-485a-bbef-efd2b0d1471d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:22 devstack sudo[98820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da
Nov 02 10:13:22 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:22 devstack sudo[98821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782
Nov 02 10:13:22 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:22 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.325s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:13:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Deleted volume successfully.
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ce09bd5f-da02-486e-a5c8-9a4158b5159c tempest-VolumesImageMetadata-400659627 None] Lock "cinder-f060cc5d-f282-4f41-81eb-ffaf6200d531-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:22 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a.f218e69e-2c0b-4c06-8c20-9e71911468da" returned: 0 in 0.308s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-f218e69e-2c0b-4c06-8c20-9e71911468da" released by "_delete_snapshot" :: held 2.494s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" released by "delete_snapshot" :: held 2.531s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Created reservations ['1118443a-c083-4653-ac78-d06a1d475374', '4c62b2aa-95b0-4a30-aa86-fe2fb789505d', '93f8768d-c387-481b-b976-9d245bb87dfd', 'f35c4ed9-2736-40d1-9e34-f841797d60df'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:22 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782" returned: 0 in 0.493s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:22 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782
Nov 02 10:13:22 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Delete snapshot completed successfully.
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-86854ba4-68cc-4186-bd22-e5a1714c2b11 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-f218e69e-2c0b-4c06-8c20-9e71911468da-delete_snapshot" released by "delete_snapshot" :: held 2.810s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:22 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8e34cb04-09d5-4441-9c74-e5b810374782" returned: 0 in 0.316s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-quobyte-8e34cb04-09d5-4441-9c74-e5b810374782" released by "delete_volume" :: held 0.899s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:22 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Created reservations ['d9e1c467-37b8-4bb0-97fd-3df281bd579c', 'efc8686f-b55b-48a9-90d9-f557398245de', '01e46696-38b3-4bf5-afbc-e2e51e27bcef', '81ed471c-bb09-472b-baf5-6683d43f37f1'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:23 devstack sudo[98832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:13:23 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "cinder-bd4fb75a-bdc5-4277-9edb-7d781a45a20a-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-bd4fb75a-bdc5-4277-9edb-7d781a45a20a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" acquired by "delete_volume" :: waited 0.030s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e655987f-da6e-4c92-b32c-21aecb7dfd32]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:23 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.462s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:13:23 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Deleted volume successfully.
Nov 02 10:13:23 devstack sudo[98835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a
Nov 02 10:13:23 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0b5b03d-a02c-4e3d-8882-b006c71f468b tempest-VolumesListAdminTestJSON-748484521 None] Lock "cinder-8e34cb04-09d5-4441-9c74-e5b810374782-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:23 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" returned: 0 in 0.494s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:23 devstack sudo[98840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a
Nov 02 10:13:23 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:24 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" returned: 0 in 0.440s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-quobyte-bd4fb75a-bdc5-4277-9edb-7d781a45a20a" released by "delete_volume" :: held 1.056s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:24 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Created reservations ['7172204a-62db-4429-a57d-66ce0e804cfc', '0ca8ce67-eeab-421d-9718-4c80dbfe0c47', '6c47faaf-b1f5-492d-8c7c-83017766abf4', '2268430b-d725-45a9-a689-a8e90891a4d8'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:24 devstack sudo[98843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:13:24 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:25 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.497s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:25 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:13:25 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Deleted volume successfully.
Nov 02 10:13:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e2845fbf-1fa2-48b6-b164-ac445e8df9d8 tempest-VolumesSnapshotListTestJSON-1167191147 None] Lock "cinder-bd4fb75a-bdc5-4277-9edb-7d781a45a20a-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:33 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=124,cinder:UPDATE=162,cinder:INSERT=48,cinder:DELETE=16 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:13:33 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:UPDATE=144,cinder:SELECT=110,cinder:DELETE=10,cinder:INSERT=39 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:13:33 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:13:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Flow 'volume_create_manager' (5a859860-2d77-4fba-8e28-e9c6011a0076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8235f47d-88d0-4f7a-8b13-8bad751f90ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8235f47d-88d0-4f7a-8b13-8bad751f90ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1190290202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d62d29a9f24078852a195889135ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:33Z,use_quota=True,user_id='6fb16848c7f44d758033b84e8a9965c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06f4538-201e-45bc-920b-1662f679dfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06f4538-201e-45bc-920b-1662f679dfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef7fe32-51a3-4962-8f20-38ad8e798375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef7fe32-51a3-4962-8f20-38ad8e798375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4', 'volume_name': 'volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6275340b-de8b-4e0b-9eb4-92314ba743f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6275340b-de8b-4e0b-9eb4-92314ba743f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b88ae17-5076-4591-ab80-d4d049fb75a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:34 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Volume 6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4', 'volume_size': 1}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1190290202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d62d29a9f24078852a195889135ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:33Z,use_quota=True,user_id='6fb16848c7f44d758033b84e8a9965c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Creating volume 6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:13:34 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:34 devstack sudo[98937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4 1073741824
Nov 02 10:13:34 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:34 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4 1073741824" returned: 0 in 0.549s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:37 devstack sudo[98943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4
Nov 02 10:13:37 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:37 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4" returned: 0 in 0.273s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] <== create_volume: return (3125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:13:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.129s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b88ae17-5076-4591-ab80-d4d049fb75a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca509db3-80f0-4f47-8022-f724797bc965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:39 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Volume volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4 (6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4): created successfully
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca509db3-80f0-4f47-8022-f724797bc965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Flow 'volume_create_manager' (5a859860-2d77-4fba-8e28-e9c6011a0076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9197b773-2b38-4d98-8368-a2e80382f9b8 tempest-VolumesTransfersV355Test-684196080 None] Created volume successfully.
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Flow 'volume_create_manager' (7aec92f9-85d4-46cd-8d65-076cdbf35a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9987bf29-4abf-4559-aed3-cd1cc0c7714c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9987bf29-4abf-4559-aed3-cd1cc0c7714c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-570872587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97685b88-3398-4175-97bd-c811fb8d6939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc61ea8c05d44507a96e51c8e596ed4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:39Z,use_quota=True,user_id='3db272811bee4541a25de8c63f854172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5056f0df-37f5-407b-a679-2bd97cd5357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5056f0df-37f5-407b-a679-2bd97cd5357e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735bdf40-bde5-45b9-b4ac-a655c0d95f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735bdf40-bde5-45b9-b4ac-a655c0d95f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97685b88-3398-4175-97bd-c811fb8d6939', 'volume_name': 'volume-97685b88-3398-4175-97bd-c811fb8d6939', 'volume_size': 2}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2480b3d8-c385-4efb-b072-5429991f2456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2480b3d8-c385-4efb-b072-5429991f2456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7f322a-ef47-499e-bbb1-731d90120f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:39 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Volume 97685b88-3398-4175-97bd-c811fb8d6939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97685b88-3398-4175-97bd-c811fb8d6939', 'volume_size': 2}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-570872587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97685b88-3398-4175-97bd-c811fb8d6939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc61ea8c05d44507a96e51c8e596ed4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:39Z,use_quota=True,user_id='3db272811bee4541a25de8c63f854172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Creating volume 97685b88-3398-4175-97bd-c811fb8d6939 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:13:39 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:13:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939 2147483648 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:39 devstack sudo[98948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939 2147483648
Nov 02 10:13:39 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:40 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939 2147483648" returned: 0 in 0.899s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:40 devstack sudo[98956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939
Nov 02 10:13:40 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:41 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939" returned: 0 in 0.477s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:41 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:13:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7f322a-ef47-499e-bbb1-731d90120f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97685b88-3398-4175-97bd-c811fb8d6939', 'volume_size': 2}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e81ada-b90e-4676-aacf-4a7a31ebb5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:41 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Volume volume-97685b88-3398-4175-97bd-c811fb8d6939 (97685b88-3398-4175-97bd-c811fb8d6939): created successfully
Nov 02 10:13:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e81ada-b90e-4676-aacf-4a7a31ebb5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Flow 'volume_create_manager' (7aec92f9-85d4-46cd-8d65-076cdbf35a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d0037f27-ccf1-4da5-926a-69b4c78a16c8 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Created volume successfully.
Nov 02 10:13:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-bf58bac5-fc13-47b5-a77e-6b569b00486c tempest-VolumesTransfersV355Test-1301483374 None] Transfer volume completed successfully.
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Acquiring lock "cinder-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Creating offline snapshot 6f5f1747-305f-4141-bdb8-7cb406c03305 of volume 97685b88-3398-4175-97bd-c811fb8d6939 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Lock "cinder-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94ba45c-d7c2-4600-926c-41db231c62db]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Acquiring lock "cinder-quobyte-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Lock "cinder-quobyte-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4" acquired by "delete_volume" :: waited 0.027s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f84cd0d-8b91-49ad-a639-13aff7a63a09]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:42 devstack sudo[98959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939
Nov 02 10:13:42 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:42 devstack sudo[98960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4
Nov 02 10:13:42 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:42 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939" returned: 0 in 0.577s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305 2G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:43 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4" returned: 0 in 0.483s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:43 devstack sudo[98969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305 2G
Nov 02 10:13:43 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:43 devstack sudo[98970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4
Nov 02 10:13:43 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:43 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4" returned: 0 in 0.317s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Lock "cinder-quobyte-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4" released by "delete_volume" :: held 0.860s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Created reservations ['46ddb37b-407b-480e-8e04-2cb3222de6c9', 'b0b434cb-522f-495f-a7ae-72b848f27d2f', '0a5e3079-b04f-465b-937c-c28743932cc3', 'abd60272-0c7a-4601-b698-73dc62a50512'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:43 devstack sudo[98978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:13:43 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:43 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305 2G" returned: 0 in 0.689s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97685b88-3398-4175-97bd-c811fb8d6939 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:43 devstack sudo[98980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97685b88-3398-4175-97bd-c811fb8d6939 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305
Nov 02 10:13:43 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:44 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.470s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:13:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Deleted volume successfully.
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-75533fbd-bee9-4e11-9963-410fa25cbf01 tempest-VolumesTransfersV355Test-1541496856 None] Lock "cinder-6c6d7f7a-8274-49ed-9cc6-6ccfa4db0bb4-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:44 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97685b88-3398-4175-97bd-c811fb8d6939 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305" returned: 0 in 0.550s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:44 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305 is being set with open permissions: ugo+rw
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:44 devstack sudo[98986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305
Nov 02 10:13:44 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:13:44 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Flow 'volume_create_manager' (584bbe0f-63f9-4e43-b4d2-9e63cff92c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f8edf0-4640-49c2-b605-95cbf1ab2faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305" returned: 0 in 0.411s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f8edf0-4640-49c2-b605-95cbf1ab2faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1129533806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbdd9e13-1f33-4399-bcdb-57079000a483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d62d29a9f24078852a195889135ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:44Z,use_quota=True,user_id='6fb16848c7f44d758033b84e8a9965c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c727cc1c-7590-45a7-ac8b-8a40a5ae08b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c727cc1c-7590-45a7-ac8b-8a40a5ae08b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f195f3a9-965f-4158-ab6d-9c80fa72650c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f195f3a9-965f-4158-ab6d-9c80fa72650c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbdd9e13-1f33-4399-bcdb-57079000a483', 'volume_name': 'volume-dbdd9e13-1f33-4399-bcdb-57079000a483', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095b87e2-e500-40d5-8812-993a756d2a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095b87e2-e500-40d5-8812-993a756d2a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bf6b59-3abf-4245-84f4-2874a945f18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:44 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Volume dbdd9e13-1f33-4399-bcdb-57079000a483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbdd9e13-1f33-4399-bcdb-57079000a483', 'volume_size': 1}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:44 devstack sudo[98989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.info
Nov 02 10:13:44 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:13:45 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Flow 'volume_create_manager' (aa4bdd72-1511-462c-bb04-100c0e8d5092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4878632c-fe01-4a18-9c47-fc2e30058da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.info" returned: 0 in 0.386s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:45 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.info is being set with open permissions: ugo+rw
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4878632c-fe01-4a18-9c47-fc2e30058da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-309641471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b5486f-57d7-40c1-a554-27903f1a40bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b7c9ee518b4230808e1d11b644566e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:45Z,use_quota=True,user_id='16b5ce80beef42d6a19b01465ecbcb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed2d102-3239-4691-be90-7196163c425e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:45 devstack sudo[98992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.info
Nov 02 10:13:45 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed2d102-3239-4691-be90-7196163c425e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55dacd41-33ab-4ff2-9a74-55dd76587e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55dacd41-33ab-4ff2-9a74-55dd76587e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b5486f-57d7-40c1-a554-27903f1a40bf', 'volume_name': 'volume-98b5486f-57d7-40c1-a554-27903f1a40bf', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea925c97-c9ca-4800-b433-d8da8abe860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea925c97-c9ca-4800-b433-d8da8abe860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7d4854-2e68-4cb4-8066-56a77ab6cdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:45 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Volume 98b5486f-57d7-40c1-a554-27903f1a40bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b5486f-57d7-40c1-a554-27903f1a40bf', 'volume_size': 1}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:45 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.info" returned: 0 in 0.265s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.096s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1129533806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbdd9e13-1f33-4399-bcdb-57079000a483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d62d29a9f24078852a195889135ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:44Z,use_quota=True,user_id='6fb16848c7f44d758033b84e8a9965c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Creating volume dbdd9e13-1f33-4399-bcdb-57079000a483 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:13:45 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:45 devstack sudo[98995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483 1073741824
Nov 02 10:13:45 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:45 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-41d87785-e0bc-469e-9f42-b4271903d7aa tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Create snapshot completed successfully
Nov 02 10:13:45 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483 1073741824" returned: 0 in 0.523s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:46 devstack sudo[99019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483
Nov 02 10:13:46 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:46 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483" returned: 0 in 0.273s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.080s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-309641471',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b5486f-57d7-40c1-a554-27903f1a40bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b7c9ee518b4230808e1d11b644566e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:13:45Z,use_quota=True,user_id='16b5ce80beef42d6a19b01465ecbcb46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Creating volume 98b5486f-57d7-40c1-a554-27903f1a40bf {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:13:46 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bf6b59-3abf-4245-84f4-2874a945f18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbdd9e13-1f33-4399-bcdb-57079000a483', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:46 devstack sudo[99022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf 1073741824
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f713e8-5710-4f07-9d39-850d077f2960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:46 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Volume volume-dbdd9e13-1f33-4399-bcdb-57079000a483 (dbdd9e13-1f33-4399-bcdb-57079000a483): created successfully
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f713e8-5710-4f07-9d39-850d077f2960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Flow 'volume_create_manager' (584bbe0f-63f9-4e43-b4d2-9e63cff92c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:46 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-970387ed-c533-4528-92a7-fa092e6ff654 tempest-VolumesTransfersV355Test-684196080 None] Created volume successfully.
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Acquiring lock "cinder-6f5f1747-305f-4141-bdb8-7cb406c03305-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "cinder-6f5f1747-305f-4141-bdb8-7cb406c03305-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Acquiring lock "cinder-quobyte-97685b88-3398-4175-97bd-c811fb8d6939" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "cinder-quobyte-97685b88-3398-4175-97bd-c811fb8d6939" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Acquiring lock "cinder-quobyte-6f5f1747-305f-4141-bdb8-7cb406c03305" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "cinder-quobyte-6f5f1747-305f-4141-bdb8-7cb406c03305" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Deleting offline snapshot 6f5f1747-305f-4141-bdb8-7cb406c03305 of volume 97685b88-3398-4175-97bd-c811fb8d6939 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] snapshot_file for this snap is: volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b8a9c5-fbb4-46e7-b02c-0941c2b2f4f8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:46 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf 1073741824" returned: 0 in 0.591s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:46 devstack sudo[99028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305
Nov 02 10:13:46 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:46 devstack sudo[99029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf
Nov 02 10:13:46 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Acquiring lock "cinder-dbdd9e13-1f33-4399-bcdb-57079000a483-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Lock "cinder-dbdd9e13-1f33-4399-bcdb-57079000a483-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Acquiring lock "cinder-quobyte-dbdd9e13-1f33-4399-bcdb-57079000a483" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Lock "cinder-quobyte-dbdd9e13-1f33-4399-bcdb-57079000a483" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[13379922-99b8-476d-a9e3-db576e6d0b7e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:47 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305" returned: 0 in 0.456s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97685b88-3398-4175-97bd-c811fb8d6939(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e83edf-befc-4085-90c4-f73297a0f566]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:47 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf" returned: 0 in 0.400s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:47 devstack sudo[99034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483
Nov 02 10:13:47 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7d4854-2e68-4cb4-8066-56a77ab6cdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b5486f-57d7-40c1-a554-27903f1a40bf', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c20953-58ab-4e95-9d9f-2a415e11ce2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:13:47 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Volume volume-98b5486f-57d7-40c1-a554-27903f1a40bf (98b5486f-57d7-40c1-a554-27903f1a40bf): created successfully
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c20953-58ab-4e95-9d9f-2a415e11ce2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Flow 'volume_create_manager' (aa4bdd72-1511-462c-bb04-100c0e8d5092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:13:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-efed50f0-517f-491a-aa22-1d5ce5508813 tempest-SnapshotMetadataTestJSON-1360069949 None] Created volume successfully.
Nov 02 10:13:47 devstack sudo[99037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939
Nov 02 10:13:47 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:47 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483" returned: 0 in 0.475s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:47 devstack sudo[99045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483
Nov 02 10:13:47 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:47 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939" returned: 0 in 0.428s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:47 devstack sudo[99048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305
Nov 02 10:13:47 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:47 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dbdd9e13-1f33-4399-bcdb-57079000a483" returned: 0 in 0.296s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Lock "cinder-quobyte-dbdd9e13-1f33-4399-bcdb-57079000a483" released by "delete_volume" :: held 0.840s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Created reservations ['9c7a1310-90b2-4f2a-a4d2-1220b9f4b0ea', 'b61510a8-33f7-4966-a4a5-56e3a8ca83e1', '3e058e2e-b2b3-4118-bd7a-3a1c3761f7aa', '902aab16-71f2-4d9b-86e0-78331ae406dd'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:48 devstack sudo[99055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:13:48 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:48 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305" returned: 0 in 0.517s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:48 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305
Nov 02 10:13:48 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:48 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.391s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] Creating offline snapshot 0cff02bd-3fc9-470f-a369-e00a7ac29a2d of volume 98b5486f-57d7-40c1-a554-27903f1a40bf {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:13:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Deleted volume successfully.
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[be71e531-751e-47ae-a8ec-24c7ac9d6926]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6a69e1f3-45fa-4dae-a6b4-6c4d8b9b6903 tempest-VolumesTransfersV355Test-1541496856 None] Lock "cinder-dbdd9e13-1f33-4399-bcdb-57079000a483-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:48 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939.6f5f1747-305f-4141-bdb8-7cb406c03305" returned: 0 in 0.379s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "cinder-quobyte-6f5f1747-305f-4141-bdb8-7cb406c03305" released by "_delete_snapshot" :: held 1.943s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "cinder-quobyte-97685b88-3398-4175-97bd-c811fb8d6939" released by "delete_snapshot" :: held 1.977s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:48 devstack sudo[99062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf
Nov 02 10:13:48 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Created reservations ['75be5a54-4b48-4c09-8fd0-d835ae802b50', '68bdf25b-63d6-454d-b27c-61df6f56cd49', '85672c24-7670-456b-9bee-ba5d755b91d6', '7b9781d0-105e-420b-acf1-ec5dd8db6edb'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Delete snapshot completed successfully.
Nov 02 10:13:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d5f5224f-eea3-4e47-9f1a-7cdcbb7fad99 tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "cinder-6f5f1747-305f-4141-bdb8-7cb406c03305-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:49 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf" returned: 0 in 0.463s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:49 devstack sudo[99068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d 1G
Nov 02 10:13:49 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:49 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d 1G" returned: 0 in 0.467s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b5486f-57d7-40c1-a554-27903f1a40bf -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:49 devstack sudo[99074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b5486f-57d7-40c1-a554-27903f1a40bf -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d
Nov 02 10:13:49 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:49 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b5486f-57d7-40c1-a554-27903f1a40bf -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d" returned: 0 in 0.341s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:49 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d is being set with open permissions: ugo+rw
Nov 02 10:13:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:49 devstack sudo[99079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d
Nov 02 10:13:49 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Acquiring lock "cinder-97685b88-3398-4175-97bd-c811fb8d6939-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "cinder-97685b88-3398-4175-97bd-c811fb8d6939-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Acquiring lock "cinder-quobyte-97685b88-3398-4175-97bd-c811fb8d6939" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "cinder-quobyte-97685b88-3398-4175-97bd-c811fb8d6939" acquired by "delete_volume" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:50 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d" returned: 0 in 0.345s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff28dd5a-4510-407a-b1d4-8583ea02e0af]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:50 devstack sudo[99083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.info
Nov 02 10:13:50 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:50 devstack sudo[99082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939
Nov 02 10:13:50 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:50 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.info" returned: 0 in 0.350s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:50 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.info is being set with open permissions: ugo+rw
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:50 devstack sudo[99090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.info
Nov 02 10:13:50 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:50 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939" returned: 0 in 0.492s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:50 devstack sudo[99093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939
Nov 02 10:13:50 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:50 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.info" returned: 0 in 0.309s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3a36da20-0980-4a24-8c69-421430e26d1a tempest-SnapshotMetadataTestJSON-1360069949 None] Create snapshot completed successfully
Nov 02 10:13:51 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-97685b88-3398-4175-97bd-c811fb8d6939" returned: 0 in 0.302s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "cinder-quobyte-97685b88-3398-4175-97bd-c811fb8d6939" released by "delete_volume" :: held 0.889s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Created reservations ['2e374603-63f6-42f9-b4d3-01107462cad6', 'd019f5a7-acde-4d04-95b6-08ee61127e57', 'b771de75-6c5c-4517-b782-41f1b9cfe2c4', 'c7bde3e8-c08f-4d1a-be2d-519af89b4fd4'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:51 devstack sudo[99097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:13:51 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:51 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.329s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:13:51 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Deleted volume successfully.
Nov 02 10:13:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5467ce13-ce15-49c8-8c33-f3d024e2a97a tempest-VolumesSnapshotNegativeTestJSON-310601323 None] Lock "cinder-97685b88-3398-4175-97bd-c811fb8d6939-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Acquiring lock "cinder-0cff02bd-3fc9-470f-a369-e00a7ac29a2d-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "cinder-0cff02bd-3fc9-470f-a369-e00a7ac29a2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Acquiring lock "cinder-quobyte-98b5486f-57d7-40c1-a554-27903f1a40bf" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "cinder-quobyte-98b5486f-57d7-40c1-a554-27903f1a40bf" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Acquiring lock "cinder-quobyte-0cff02bd-3fc9-470f-a369-e00a7ac29a2d" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "cinder-quobyte-0cff02bd-3fc9-470f-a369-e00a7ac29a2d" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Deleting offline snapshot 0cff02bd-3fc9-470f-a369-e00a7ac29a2d of volume 98b5486f-57d7-40c1-a554-27903f1a40bf {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] snapshot_file for this snap is: volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc8b247-feff-4d74-9be7-31f0cd10d61a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:53 devstack sudo[99100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d
Nov 02 10:13:53 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:53 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d" returned: 0 in 0.542s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98b5486f-57d7-40c1-a554-27903f1a40bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[17090028-7c94-41f4-9651-1cdf0313d88d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:54 devstack sudo[99106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf
Nov 02 10:13:54 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:54 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf" returned: 0 in 0.606s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:54 devstack sudo[99111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d
Nov 02 10:13:54 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:55 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d" returned: 0 in 0.504s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:55 devstack sudo[99117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d
Nov 02 10:13:55 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:55 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf.0cff02bd-3fc9-470f-a369-e00a7ac29a2d" returned: 0 in 0.342s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "cinder-quobyte-0cff02bd-3fc9-470f-a369-e00a7ac29a2d" released by "_delete_snapshot" :: held 2.209s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "cinder-quobyte-98b5486f-57d7-40c1-a554-27903f1a40bf" released by "delete_snapshot" :: held 2.274s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:55 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Created reservations ['42f6b141-79e9-4a49-8ec8-34ede159c8d2', '7a0d58a1-1d93-473e-b723-8280135f5d4a', 'cd97e5f0-28da-4e73-8ea4-840f3eef90cd', 'ba8e5de0-ff4e-4a2c-b122-fae34b6a2fdf'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:55 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Delete snapshot completed successfully.
Nov 02 10:13:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8cce69ce-287e-47be-865a-3ab5e92c6867 tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "cinder-0cff02bd-3fc9-470f-a369-e00a7ac29a2d-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Acquiring lock "cinder-98b5486f-57d7-40c1-a554-27903f1a40bf-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "cinder-98b5486f-57d7-40c1-a554-27903f1a40bf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Acquiring lock "cinder-quobyte-98b5486f-57d7-40c1-a554-27903f1a40bf" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:13:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "cinder-quobyte-98b5486f-57d7-40c1-a554-27903f1a40bf" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:13:56 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5331de56-7040-4666-9b72-a4049cadfb9a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:13:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:56 devstack sudo[99126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf
Nov 02 10:13:56 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:57 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf" returned: 0 in 0.524s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:57 devstack sudo[99131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf
Nov 02 10:13:57 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:57 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98b5486f-57d7-40c1-a554-27903f1a40bf" returned: 0 in 0.317s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "cinder-quobyte-98b5486f-57d7-40c1-a554-27903f1a40bf" released by "delete_volume" :: held 0.930s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:13:57 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Created reservations ['8f5003c1-0794-43ff-81ab-9b0cdc17384d', 'a4757c80-ae7d-4caa-b471-98458832f4e9', '37206f8e-78dd-4fa1-9db5-a47e8b161412', 'e169dced-9fa6-4f22-9d1f-0e20cb232345'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:13:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:13:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:13:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:13:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:13:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:13:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:13:57 devstack sudo[99134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:13:57 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:13:58 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root
Nov 02 10:13:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.308s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:13:58 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:13:58 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Deleted volume successfully.
Nov 02 10:13:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-135ca4c5-8177-4240-9485-828cf2f539df tempest-SnapshotMetadataTestJSON-1360069949 None] Lock "cinder-98b5486f-57d7-40c1-a554-27903f1a40bf-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:07 devstack sudo[99143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:14:07 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:07 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.490s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=47,cinder:UPDATE=56,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Flow 'volume_create_manager' (961a582e-64f1-4ec3-8729-431c5d25418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6271978a-203a-4a87-b6e0-343e9235ead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6271978a-203a-4a87-b6e0-343e9235ead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-638078849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bb52ce-d422-4607-87ae-885c17324875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ebbefb24fb0456397d4b7ab327e966a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:08Z,use_quota=True,user_id='f584d84fd3664c1eae36af2a7cfefd3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a2ab8b-18f4-4c2f-a40e-cfc9ab06739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a2ab8b-18f4-4c2f-a40e-cfc9ab06739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c343ea5-7559-4967-b2aa-5a0edd84c51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c343ea5-7559-4967-b2aa-5a0edd84c51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87bb52ce-d422-4607-87ae-885c17324875', 'volume_name': 'volume-87bb52ce-d422-4607-87ae-885c17324875', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f6b64c-101e-4647-9bf7-4ef4ce940fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f6b64c-101e-4647-9bf7-4ef4ce940fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb259c1-1e65-4bea-a4c0-4d3c5687ab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:08 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Volume 87bb52ce-d422-4607-87ae-885c17324875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87bb52ce-d422-4607-87ae-885c17324875', 'volume_size': 1}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-638078849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bb52ce-d422-4607-87ae-885c17324875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ebbefb24fb0456397d4b7ab327e966a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:08Z,use_quota=True,user_id='f584d84fd3664c1eae36af2a7cfefd3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Creating volume 87bb52ce-d422-4607-87ae-885c17324875 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:08 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:08 devstack sudo[99146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875 1073741824
Nov 02 10:14:08 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:08 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875 1073741824" returned: 0 in 0.699s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:08 devstack sudo[99153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875
Nov 02 10:14:08 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:09 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875" returned: 0 in 0.357s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb259c1-1e65-4bea-a4c0-4d3c5687ab6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87bb52ce-d422-4607-87ae-885c17324875', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb6402c-0e6e-4cee-93a0-dd81c532cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:09 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Volume volume-87bb52ce-d422-4607-87ae-885c17324875 (87bb52ce-d422-4607-87ae-885c17324875): created successfully
Nov 02 10:14:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb6402c-0e6e-4cee-93a0-dd81c532cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Flow 'volume_create_manager' (961a582e-64f1-4ec3-8729-431c5d25418f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4e4c933c-7330-4c83-9fdf-4aabeb932aca tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Created volume successfully.
Nov 02 10:14:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-cd6f38c9-fb06-4cf0-85e6-ac683942ba18 req-5b4a966d-eae2-4d82-83a3-02248f0e1f35 tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-cd6f38c9-fb06-4cf0-85e6-ac683942ba18 req-5b4a966d-eae2-4d82-83a3-02248f0e1f35 tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-cd6f38c9-fb06-4cf0-85e6-ac683942ba18 req-5b4a966d-eae2-4d82-83a3-02248f0e1f35 tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-cd6f38c9-fb06-4cf0-85e6-ac683942ba18 req-5b4a966d-eae2-4d82-83a3-02248f0e1f35 tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-87bb52ce-d422-4607-87ae-885c17324875', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2e4ad3c-262f-4109-a234-755a7307c734', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:14:11 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-cd6f38c9-fb06-4cf0-85e6-ac683942ba18 req-5b4a966d-eae2-4d82-83a3-02248f0e1f35 tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] attachment_update completed successfully.
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Flow 'volume_create_manager' (ba0962e1-e867-45e9-ae24-f53b74db80fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd727b4a-b03d-4eb9-b3df-b895afbc0486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd727b4a-b03d-4eb9-b3df-b895afbc0486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1408849862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42b05f4-631e-4f23-b4e2-9172ad3beb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad651b4b0c9479b98d05cdda22d2c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:12Z,use_quota=True,user_id='d7b9962ab3a040acb3bc744d303ad955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3728402a-5bcb-485b-aec0-31e84f437128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3728402a-5bcb-485b-aec0-31e84f437128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085faf24-6ff6-41e2-97b2-3368d5d8d1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085faf24-6ff6-41e2-97b2-3368d5d8d1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd42b05f4-631e-4f23-b4e2-9172ad3beb19', 'volume_name': 'volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c636e14-2540-4c9a-8766-43bef843e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c636e14-2540-4c9a-8766-43bef843e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c714a68-10d0-42d6-9e16-ac19e8e6b197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:12 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Volume d42b05f4-631e-4f23-b4e2-9172ad3beb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19', 'volume_size': 1}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1408849862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42b05f4-631e-4f23-b4e2-9172ad3beb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad651b4b0c9479b98d05cdda22d2c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:12Z,use_quota=True,user_id='d7b9962ab3a040acb3bc744d303ad955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Creating volume d42b05f4-631e-4f23-b4e2-9172ad3beb19 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:12 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:12 devstack sudo[99619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19 1073741824
Nov 02 10:14:12 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:13 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19 1073741824" returned: 0 in 0.799s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:13 devstack sudo[99625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19
Nov 02 10:14:13 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:13 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19" returned: 0 in 0.395s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:13 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c714a68-10d0-42d6-9e16-ac19e8e6b197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:13 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9275d1-2482-40db-9545-7f590e35bd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:13 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Volume volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19 (d42b05f4-631e-4f23-b4e2-9172ad3beb19): created successfully
Nov 02 10:14:13 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9275d1-2482-40db-9545-7f590e35bd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:13 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Flow 'volume_create_manager' (ba0962e1-e867-45e9-ae24-f53b74db80fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:13 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5e28c05e-3354-40ba-9f13-0194e7dada50 tempest-AbsoluteLimitsTests-230731619 None] Created volume successfully.
Nov 02 10:14:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Acquiring lock "cinder-d42b05f4-631e-4f23-b4e2-9172ad3beb19-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Lock "cinder-d42b05f4-631e-4f23-b4e2-9172ad3beb19-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Acquiring lock "cinder-quobyte-d42b05f4-631e-4f23-b4e2-9172ad3beb19" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Lock "cinder-quobyte-d42b05f4-631e-4f23-b4e2-9172ad3beb19" acquired by "delete_volume" :: waited 0.069s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:14 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c35d803-d813-44ca-bff2-b5a81a6279fd]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:14:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:15 devstack sudo[99628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19
Nov 02 10:14:15 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:15 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19" returned: 0 in 0.801s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:15 devstack sudo[99634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19
Nov 02 10:14:15 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-a8f751b3-63c0-480e-99e2-14c47d4d448a req-df0cf8b7-9b41-4b08-8d80-af13db77014c tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Terminate volume connection completed successfully.
Nov 02 10:14:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-a8f751b3-63c0-480e-99e2-14c47d4d448a req-df0cf8b7-9b41-4b08-8d80-af13db77014c tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Deleting attachment e2e4ad3c-262f-4109-a234-755a7307c734. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:14:16 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d42b05f4-631e-4f23-b4e2-9172ad3beb19" returned: 0 in 0.548s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Lock "cinder-quobyte-d42b05f4-631e-4f23-b4e2-9172ad3beb19" released by "delete_volume" :: held 1.502s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Created reservations ['e0ca210b-ade7-43b5-834e-bd328a267325', 'aa345ac4-07b0-410a-b514-0ea63f15a60e', '72996106-4106-428a-84e2-6d91e16ea5fb', 'e203c40a-6ad5-4c5a-9ed2-10dd7fa53ddf'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:16 devstack sudo[99663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:14:16 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:16 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.428s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:14:16 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Deleted volume successfully.
Nov 02 10:14:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2fc8db32-b5cd-4918-a2f4-ff58f0e1b8ad tempest-AbsoluteLimitsTests-230731619 None] Lock "cinder-d42b05f4-631e-4f23-b4e2-9172ad3beb19-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Flow 'volume_create_manager' (96f038e1-abc7-4541-bbec-f5e299c7c7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e5726b-1cdc-4914-aeaf-b9f4c6a274be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e5726b-1cdc-4914-aeaf-b9f4c6a274be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-961352717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8315302-bb0e-4721-8ffd-65da6fd9b1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c3046b93514e20817976ae08b62c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:17Z,use_quota=True,user_id='1304e0387c114a49bcdbd218d9633648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a88133a-fd1b-49e3-9835-ecea73963207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a88133a-fd1b-49e3-9835-ecea73963207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa99352-9009-42a5-8fcb-5b61d9ba17ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa99352-9009-42a5-8fcb-5b61d9ba17ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8315302-bb0e-4721-8ffd-65da6fd9b1cc', 'volume_name': 'volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ad5e18-62d3-422c-8beb-ac12b4e695a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ad5e18-62d3-422c-8beb-ac12b4e695a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71efe1b-0037-41dc-9a12-a26ab4c0f746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:17 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Volume c8315302-bb0e-4721-8ffd-65da6fd9b1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc', 'volume_size': 1}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-961352717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8315302-bb0e-4721-8ffd-65da6fd9b1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c3046b93514e20817976ae08b62c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:17Z,use_quota=True,user_id='1304e0387c114a49bcdbd218d9633648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Creating volume c8315302-bb0e-4721-8ffd-65da6fd9b1cc {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:17 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Acquiring lock "cinder-87bb52ce-d422-4607-87ae-885c17324875-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:17 devstack sudo[99666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc 1073741824
Nov 02 10:14:17 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "cinder-87bb52ce-d422-4607-87ae-885c17324875-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Acquiring lock "cinder-quobyte-87bb52ce-d422-4607-87ae-885c17324875" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "cinder-quobyte-87bb52ce-d422-4607-87ae-885c17324875" acquired by "delete_volume" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c18db7-4b02-44b7-912a-7bd00d3d3edc]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:14:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:18 devstack sudo[99668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875
Nov 02 10:14:18 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:18 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc 1073741824" returned: 0 in 0.904s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:18 devstack sudo[99678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc
Nov 02 10:14:18 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:18 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875" returned: 0 in 0.794s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:18 devstack sudo[99680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875
Nov 02 10:14:18 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:19 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" returned: 0 in 0.432s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71efe1b-0037-41dc-9a12-a26ab4c0f746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60e53ce-bd10-4bc0-bbdb-752838876275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:19 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Volume volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc (c8315302-bb0e-4721-8ffd-65da6fd9b1cc): created successfully
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60e53ce-bd10-4bc0-bbdb-752838876275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Flow 'volume_create_manager' (96f038e1-abc7-4541-bbec-f5e299c7c7ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-87398cd2-62cd-4110-94ee-7d77181b2ad4 tempest-VolumesActionsTest-1152702528 None] Created volume successfully.
Nov 02 10:14:19 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-87bb52ce-d422-4607-87ae-885c17324875" returned: 0 in 0.653s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "cinder-quobyte-87bb52ce-d422-4607-87ae-885c17324875" released by "delete_volume" :: held 1.529s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Created reservations ['27d802f3-7d0c-4d4e-b893-40ae7a812154', '95fdad9b-8a7d-407d-b9c5-c3f3897fc9be', '55a91fe9-96da-423a-bdf5-e1ec9bb1f5c8', '34618a3e-db52-44b8-8677-d3f337ee8cbb'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:19 devstack sudo[99684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:14:19 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:20 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.363s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:20 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:14:20 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Deleted volume successfully.
Nov 02 10:14:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a01c4b51-c719-4385-a805-f5456dde5b2e tempest-TestServerVolumeAttachScenarioOldVersion-1211946516 None] Lock "cinder-87bb52ce-d422-4607-87ae-885c17324875-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Flow 'volume_create_manager' (8dcbe12e-71bd-43ef-a07c-f231d78ed8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38543fa-5c4f-4793-bda5-dab55de53f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38543fa-5c4f-4793-bda5-dab55de53f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2082202808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3867db08-1f9b-40b1-93e1-78b92e39e625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5601134516d6417894776442fb2225d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:30Z,use_quota=True,user_id='50d7f3528b3b4070802934d5b65e9d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af4b78f-606e-4fa9-9f7e-f82cb3f3bcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af4b78f-606e-4fa9-9f7e-f82cb3f3bcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cdfed0-6e35-449d-812d-bd25674fc271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50cdfed0-6e35-449d-812d-bd25674fc271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3867db08-1f9b-40b1-93e1-78b92e39e625', 'volume_name': 'volume-3867db08-1f9b-40b1-93e1-78b92e39e625', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e45c7c-dc2e-477d-974b-2caefd44f34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e45c7c-dc2e-477d-974b-2caefd44f34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90894e08-14c6-4e86-91d3-3821f7dedd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:29 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Volume 3867db08-1f9b-40b1-93e1-78b92e39e625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3867db08-1f9b-40b1-93e1-78b92e39e625', 'volume_size': 1}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2082202808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3867db08-1f9b-40b1-93e1-78b92e39e625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5601134516d6417894776442fb2225d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:30Z,use_quota=True,user_id='50d7f3528b3b4070802934d5b65e9d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Creating volume 3867db08-1f9b-40b1-93e1-78b92e39e625 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:29 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:29 devstack sudo[99738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625 1073741824
Nov 02 10:14:29 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:30 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625 1073741824" returned: 0 in 0.665s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:30 devstack sudo[99744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625
Nov 02 10:14:30 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:30 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625" returned: 0 in 0.374s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90894e08-14c6-4e86-91d3-3821f7dedd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3867db08-1f9b-40b1-93e1-78b92e39e625', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4985f2-5a72-4884-8b19-8aa717ae5f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:30 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Volume volume-3867db08-1f9b-40b1-93e1-78b92e39e625 (3867db08-1f9b-40b1-93e1-78b92e39e625): created successfully
Nov 02 10:14:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4985f2-5a72-4884-8b19-8aa717ae5f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Flow 'volume_create_manager' (8dcbe12e-71bd-43ef-a07c-f231d78ed8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:31 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2d8b998a-9ba1-4780-855e-bf85bbbb2660 tempest-VolumesMetadataTest-646751272 None] Created volume successfully.
Nov 02 10:14:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Acquiring lock "cinder-3867db08-1f9b-40b1-93e1-78b92e39e625-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Lock "cinder-3867db08-1f9b-40b1-93e1-78b92e39e625-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Acquiring lock "cinder-quobyte-3867db08-1f9b-40b1-93e1-78b92e39e625" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Lock "cinder-quobyte-3867db08-1f9b-40b1-93e1-78b92e39e625" acquired by "delete_volume" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4820d70c-31ac-4801-8e8a-be4ffab19c3b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:14:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:33 devstack sudo[99749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625
Nov 02 10:14:33 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:33 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625" returned: 0 in 0.495s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:33 devstack sudo[99756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625
Nov 02 10:14:33 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:33 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3867db08-1f9b-40b1-93e1-78b92e39e625" returned: 0 in 0.330s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Lock "cinder-quobyte-3867db08-1f9b-40b1-93e1-78b92e39e625" released by "delete_volume" :: held 0.914s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Created reservations ['0ac6a9e7-7581-4437-92f0-8b7f1a10aac5', '4be6114d-63ea-4d05-b8f8-0a702000a923', '8bb2ddca-775b-4485-85da-ceed6c10c537', '2c1e3148-aef0-45e2-afd4-0a9fd5a6bd1c'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=75,cinder:UPDATE=93,cinder:DELETE=10,cinder:INSERT=21 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:34 devstack sudo[99759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:14:34 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Flow 'volume_create_manager' (be2452b1-dab7-43e0-a3a6-bfc15c8bdcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc01ff37-8277-4411-99d0-91a471daa7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc01ff37-8277-4411-99d0-91a471daa7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-534642388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa35830a-9d1d-4894-8be1-2b169c725502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893cbb1fbce44e0d82b05724d353e532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:34Z,use_quota=True,user_id='e894fb1f0c02423f92c663de9264c1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcbabf0a-dc51-4d2c-88dc-2e069ece449a),volume_type_id=dcbabf0a-dc51-4d2c-88dc-2e069ece449a)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1789338-7cc9-4c6b-9b3b-b168f0303557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1789338-7cc9-4c6b-9b3b-b168f0303557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de6c8da-0b6f-4e70-ae1e-f85956cf25cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de6c8da-0b6f-4e70-ae1e-f85956cf25cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa35830a-9d1d-4894-8be1-2b169c725502', 'volume_name': 'volume-aa35830a-9d1d-4894-8be1-2b169c725502', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb08aed4-fef1-4527-bb36-667280a1ba55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb08aed4-fef1-4527-bb36-667280a1ba55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d62bbed-763c-45b3-a433-0f586347772c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:34 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Volume aa35830a-9d1d-4894-8be1-2b169c725502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa35830a-9d1d-4894-8be1-2b169c725502', 'volume_size': 1}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-534642388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa35830a-9d1d-4894-8be1-2b169c725502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893cbb1fbce44e0d82b05724d353e532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:34Z,use_quota=True,user_id='e894fb1f0c02423f92c663de9264c1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dcbabf0a-dc51-4d2c-88dc-2e069ece449a),volume_type_id=dcbabf0a-dc51-4d2c-88dc-2e069ece449a)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Creating volume aa35830a-9d1d-4894-8be1-2b169c725502 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:34 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:34 devstack sudo[99776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502 1073741824
Nov 02 10:14:34 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:34 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.628s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:34 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:14:34 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Deleted volume successfully.
Nov 02 10:14:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b1271e35-076b-46f1-831a-0128c33b74a7 tempest-VolumesMetadataTest-646751272 None] Lock "cinder-3867db08-1f9b-40b1-93e1-78b92e39e625-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:35 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502 1073741824" returned: 0 in 0.988s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:35 devstack sudo[99831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502
Nov 02 10:14:35 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:35 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Flow 'volume_create_manager' (8428e42d-8c32-48e6-9d76-768f75faa360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07872969-05f0-46eb-840e-93821741e9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07872969-05f0-46eb-840e-93821741e9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1261324465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d90e23-78b3-49ca-876d-741eb90f4812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893cbb1fbce44e0d82b05724d353e532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:36Z,use_quota=True,user_id='e894fb1f0c02423f92c663de9264c1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c99c285-350f-4560-a6d5-2ddac49951ea),volume_type_id=6c99c285-350f-4560-a6d5-2ddac49951ea)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5176658-10aa-4bca-afa1-3bf5ba6132e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5176658-10aa-4bca-afa1-3bf5ba6132e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d098ae2-6bc7-482e-817e-182a746f5473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d098ae2-6bc7-482e-817e-182a746f5473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d90e23-78b3-49ca-876d-741eb90f4812', 'volume_name': 'volume-20d90e23-78b3-49ca-876d-741eb90f4812', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7a620d-ffd3-45f5-9099-b7ccf0667f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7a620d-ffd3-45f5-9099-b7ccf0667f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441c05b7-ad39-495b-9830-9ba85ebfd7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:36 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Volume 20d90e23-78b3-49ca-876d-741eb90f4812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d90e23-78b3-49ca-876d-741eb90f4812', 'volume_size': 1}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:36 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502" returned: 0 in 0.646s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.258s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1261324465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d90e23-78b3-49ca-876d-741eb90f4812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893cbb1fbce44e0d82b05724d353e532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:36Z,use_quota=True,user_id='e894fb1f0c02423f92c663de9264c1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c99c285-350f-4560-a6d5-2ddac49951ea),volume_type_id=6c99c285-350f-4560-a6d5-2ddac49951ea)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Creating volume 20d90e23-78b3-49ca-876d-741eb90f4812 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:36 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d62bbed-763c-45b3-a433-0f586347772c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa35830a-9d1d-4894-8be1-2b169c725502', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:36 devstack sudo[99836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812 1073741824
Nov 02 10:14:36 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3558ca3-5b64-4f07-93ea-0cb5023f7bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:36 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Volume volume-aa35830a-9d1d-4894-8be1-2b169c725502 (aa35830a-9d1d-4894-8be1-2b169c725502): created successfully
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3558ca3-5b64-4f07-93ea-0cb5023f7bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Flow 'volume_create_manager' (be2452b1-dab7-43e0-a3a6-bfc15c8bdcf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-93149a90-6bf5-4f27-9bf6-8a9e7456db63 tempest-TestInstancesWithCinderVolumes-254229861 None] Created volume successfully.
Nov 02 10:14:37 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Flow 'volume_create_manager' (bb35cfc3-7076-4718-aea4-70f97e33074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88007e4d-2763-45c0-b941-a718a61b1426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:37 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88007e4d-2763-45c0-b941-a718a61b1426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1347875974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158c7b8d-9ee9-4c1c-be2a-1c9331d2053c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893cbb1fbce44e0d82b05724d353e532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:37Z,use_quota=True,user_id='e894fb1f0c02423f92c663de9264c1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d14b0a8a-4022-443b-a1e0-ebe6b1afa9a4),volume_type_id=d14b0a8a-4022-443b-a1e0-ebe6b1afa9a4)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946ff566-b70a-4ca7-9988-43025bb79e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946ff566-b70a-4ca7-9988-43025bb79e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d117627-b93d-4ae6-a273-51c98f39cc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:37 devstack cinder-volume[87014]: DEBUG cinder.image.glance [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Creating Keystone auth plugin from conf {{(pid=87014) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 02 10:14:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812 1073741824" returned: 0 in 1.255s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:37 devstack sudo[99846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812
Nov 02 10:14:37 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:38 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812" returned: 0 in 0.564s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441c05b7-ad39-495b-9830-9ba85ebfd7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d90e23-78b3-49ca-876d-741eb90f4812', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8642df-3835-4995-867b-d6f7d6beda34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:38 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Volume volume-20d90e23-78b3-49ca-876d-741eb90f4812 (20d90e23-78b3-49ca-876d-741eb90f4812): created successfully
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8642df-3835-4995-867b-d6f7d6beda34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Flow 'volume_create_manager' (8428e42d-8c32-48e6-9d76-768f75faa360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:38 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1b444b3c-5e27-4e29-bf0b-6ad015a4f25d tempest-TestInstancesWithCinderVolumes-254229861 None] Created volume successfully.
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d117627-b93d-4ae6-a273-51c98f39cc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '158c7b8d-9ee9-4c1c-be2a-1c9331d2053c', 'volume_name': 'volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c', 'volume_size': 1, 'image_id': '8597227a-8c6f-4093-bfe1-6fee00454944', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8597227a-8c6f-4093-bfe1-6fee00454944', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--210125307', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '893cbb1fbce44e0d82b05724d353e532', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8597227a-8c6f-4093-bfe1-6fee00454944', 'created_at': datetime.datetime(2026, 11, 2, 9, 14, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8597227a-8c6f-4093-bfe1-6fee00454944/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f06a420>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f915a1-40ae-4bb6-8465-6ecf57051d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f915a1-40ae-4bb6-8465-6ecf57051d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5528b2-417f-4b30-931e-8652d23f0e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:38 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Volume 158c7b8d-9ee9-4c1c-be2a-1c9331d2053c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c', 'volume_size': 1, 'image_id': '8597227a-8c6f-4093-bfe1-6fee00454944', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8597227a-8c6f-4093-bfe1-6fee00454944', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--210125307', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '893cbb1fbce44e0d82b05724d353e532', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8597227a-8c6f-4093-bfe1-6fee00454944', 'created_at': datetime.datetime(2026, 11, 2, 9, 14, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8597227a-8c6f-4093-bfe1-6fee00454944/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f06a420>}
Nov 02 10:14:38 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Trying to clone 158c7b8d-9ee9-4c1c-be2a-1c9331d2053c from image 8597227a-8c6f-4093-bfe1-6fee00454944 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8597227a-8c6f-4093-bfe1-6fee00454944', 'metadata': {}}]). {{(pid=87014) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 02 10:14:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ed62d777-ea95-4491-af8f-b6a1c89470e9 tempest-VolumesActionsTest-1152702528 None] Acquiring lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" by "attach_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ed62d777-ea95-4491-af8f-b6a1c89470e9 tempest-VolumesActionsTest-1152702528 None] Lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" acquired by "attach_volume" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:40 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ed62d777-ea95-4491-af8f-b6a1c89470e9 tempest-VolumesActionsTest-1152702528 None] Attaching volume c8315302-bb0e-4721-8ffd-65da6fd9b1cc to instance b1cb17e0-73d2-469d-ac43-bdf47177bc0e at mountpoint /dev/vdb on host None.
Nov 02 10:14:40 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ed62d777-ea95-4491-af8f-b6a1c89470e9 tempest-VolumesActionsTest-1152702528 None] Attach volume completed successfully.
Nov 02 10:14:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ed62d777-ea95-4491-af8f-b6a1c89470e9 tempest-VolumesActionsTest-1152702528 None] Lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" released by "attach_volume" :: held 0.241s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0d039b5b-4338-4612-9d50-590c2dd2c6c2 tempest-VolumesActionsTest-1152702528 None] Acquiring lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc-detach_volume" by "detach_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0d039b5b-4338-4612-9d50-590c2dd2c6c2 tempest-VolumesActionsTest-1152702528 None] Lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:40 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0d039b5b-4338-4612-9d50-590c2dd2c6c2 tempest-VolumesActionsTest-1152702528 None] Detaching volume c8315302-bb0e-4721-8ffd-65da6fd9b1cc from instance b1cb17e0-73d2-469d-ac43-bdf47177bc0e.
Nov 02 10:14:40 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0d039b5b-4338-4612-9d50-590c2dd2c6c2 tempest-VolumesActionsTest-1152702528 None] Detach volume completed successfully.
Nov 02 10:14:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0d039b5b-4338-4612-9d50-590c2dd2c6c2 tempest-VolumesActionsTest-1152702528 None] Lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:43 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD, size 20.69 MB, duration 5.27 sec {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 02 10:14:43 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Image download 20.69 MB at 3.92 MB/s
Nov 02 10:14:43 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3b67c5-059c-4326-9198-56f56f7d2b21]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:14:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:44 devstack sudo[99875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD
Nov 02 10:14:44 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:44 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD" returned: 0 in 0.503s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:44 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Temporary image 8597227a-8c6f-4093-bfe1-6fee00454944 is fetched for user e894fb1f0c02423f92c663de9264c1fa. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 02 10:14:44 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c269ca-f984-4995-9ff2-69d27463a499]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:14:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:44 devstack sudo[99880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD
Nov 02 10:14:44 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:45 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1347875974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158c7b8d-9ee9-4c1c-be2a-1c9331d2053c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='893cbb1fbce44e0d82b05724d353e532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:37Z,use_quota=True,user_id='e894fb1f0c02423f92c663de9264c1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d14b0a8a-4022-443b-a1e0-ebe6b1afa9a4),volume_type_id=d14b0a8a-4022-443b-a1e0-ebe6b1afa9a4)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Creating volume 158c7b8d-9ee9-4c1c-be2a-1c9331d2053c {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:45 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:45 devstack sudo[99885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c 1073741824
Nov 02 10:14:45 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:45 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c 1073741824" returned: 0 in 0.680s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:45 devstack sudo[99892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c
Nov 02 10:14:45 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:46 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c" returned: 0 in 0.367s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Flow 'volume_create_manager' (ae73ce5f-e4f4-4fcc-8967-88705b9d1732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815c5d1b-0eef-43bb-bee3-99c63f375ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Attempting download of 8597227a-8c6f-4093-bfe1-6fee00454944 ((None, [{'url': 'file:///opt/stack/data/glance/images/8597227a-8c6f-4093-bfe1-6fee00454944', 'metadata': {}}])) to volume 158c7b8d-9ee9-4c1c-be2a-1c9331d2053c. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815c5d1b-0eef-43bb-bee3-99c63f375ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-868510417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a3d46d-550b-4595-93c4-baf3b84c045c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbbde45bef344dfbcb60da5867bbecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:46Z,use_quota=True,user_id='b42922f67ff14678adf3a6cb6ea30d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a491cf7c-1f50-42e2-96f0-09359c4bc2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a491cf7c-1f50-42e2-96f0-09359c4bc2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdce81b2-eb5d-4941-ac4f-84c476bfc50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdce81b2-eb5d-4941-ac4f-84c476bfc50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a3d46d-550b-4595-93c4-baf3b84c045c', 'volume_name': 'volume-84a3d46d-550b-4595-93c4-baf3b84c045c', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2e5182-a28c-4fec-b601-97fb5bc70885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2e5182-a28c-4fec-b601-97fb5bc70885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf24dd00-422c-444e-adca-7e7ed7fa699b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Volume 84a3d46d-550b-4595-93c4-baf3b84c045c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a3d46d-550b-4595-93c4-baf3b84c045c', 'volume_size': 1}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-868510417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a3d46d-550b-4595-93c4-baf3b84c045c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbbde45bef344dfbcb60da5867bbecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:46Z,use_quota=True,user_id='b42922f67ff14678adf3a6cb6ea30d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Creating volume 84a3d46d-550b-4595-93c4-baf3b84c045c {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:46 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:46 devstack sudo[99895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c 1073741824
Nov 02 10:14:46 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5331ad6-06d7-4757-a027-8a58349788ae]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8597227a-8c6f-4093-bfe1-6fee00454944_un2_ruvx {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:46 devstack sudo[99900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8597227a-8c6f-4093-bfe1-6fee00454944_un2_ruvx
Nov 02 10:14:46 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:46 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8597227a-8c6f-4093-bfe1-6fee00454944_un2_ruvx" returned: 0 in 0.529s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8597227a-8c6f-4093-bfe1-6fee00454944_un2_ruvx {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:47 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c 1073741824" returned: 0 in 0.693s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:47 devstack sudo[99908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8597227a-8c6f-4093-bfe1-6fee00454944_un2_ruvx
Nov 02 10:14:47 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:47 devstack sudo[99909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c
Nov 02 10:14:47 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:47 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8597227a-8c6f-4093-bfe1-6fee00454944_un2_ruvx" returned: 1 in 0.488s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8597227a-8c6f-4093-bfe1-6fee00454944_un2_ruvx' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ba9108-807d-44ab-ab4e-82f4fe82f341]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:47 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c" returned: 0 in 0.453s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf24dd00-422c-444e-adca-7e7ed7fa699b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a3d46d-550b-4595-93c4-baf3b84c045c', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd1cea9-f4c7-432b-834a-8ee97ff2015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:47 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD
Nov 02 10:14:47 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:47 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Volume volume-84a3d46d-550b-4595-93c4-baf3b84c045c (84a3d46d-550b-4595-93c4-baf3b84c045c): created successfully
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd1cea9-f4c7-432b-834a-8ee97ff2015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Flow 'volume_create_manager' (ae73ce5f-e4f4-4fcc-8967-88705b9d1732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6d727b5b-6b4a-4ed8-876c-db7d1c2a6967 tempest-VolumesTransfersV357Test-304920484 None] Created volume successfully.
Nov 02 10:14:47 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD" returned: 0 in 0.504s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] 8597227a-8c6f-4093-bfe1-6fee00454944 was qcow2, converting to qcow2 {{(pid=87014) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 02 10:14:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:47 devstack sudo[99920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c
Nov 02 10:14:47 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:49 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d2ccc5a6-c2b8-499d-a83b-e79c3083eb21 tempest-VolumesTransfersV357Test-1641533812 None] Transfer volume completed successfully.
Nov 02 10:14:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Acquiring lock "cinder-84a3d46d-550b-4595-93c4-baf3b84c045c-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:50 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c" returned: 0 in 2.919s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:50 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8597227a-8c6f-4093-bfe1-6fee00454944_3f_azkw0devstack@QuobyteHD, size 112.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:14:50 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Converted 112.00 MB image at 38.35 MB/s
Nov 02 10:14:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Lock "cinder-84a3d46d-550b-4595-93c4-baf3b84c045c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:50 devstack sudo[99945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c 1G
Nov 02 10:14:50 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Acquiring lock "cinder-quobyte-84a3d46d-550b-4595-93c4-baf3b84c045c" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Lock "cinder-quobyte-84a3d46d-550b-4595-93c4-baf3b84c045c" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[33728205-bbc4-4e53-82d6-f729aec13a46]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Flow 'volume_create_manager' (64aa83ae-82e0-4d2b-87e8-de02de6c8ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891df8fb-4c87-4b65-b1df-6f26c1038307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:51 devstack sudo[99947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c
Nov 02 10:14:51 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891df8fb-4c87-4b65-b1df-6f26c1038307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-864665175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804df60e-ddb0-40d6-b855-84c8c2882765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf569521506d4520b86f5ab11a837507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:51Z,use_quota=True,user_id='54cec8c23ee84d4f9ea05e1845426755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1754368-8fdd-4228-b5a3-85ccd0292ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1754368-8fdd-4228-b5a3-85ccd0292ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098937e7-18fe-47fd-93c6-6499f19f8a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098937e7-18fe-47fd-93c6-6499f19f8a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '804df60e-ddb0-40d6-b855-84c8c2882765', 'volume_name': 'volume-804df60e-ddb0-40d6-b855-84c8c2882765', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf892f6-bc7a-4387-a425-a5270d1471c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf892f6-bc7a-4387-a425-a5270d1471c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c7fd53-0aba-4da1-b351-3ce8d09a491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:51 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Volume 804df60e-ddb0-40d6-b855-84c8c2882765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-804df60e-ddb0-40d6-b855-84c8c2882765', 'volume_size': 1}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-864665175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804df60e-ddb0-40d6-b855-84c8c2882765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf569521506d4520b86f5ab11a837507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:51Z,use_quota=True,user_id='54cec8c23ee84d4f9ea05e1845426755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Creating volume 804df60e-ddb0-40d6-b855-84c8c2882765 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:51 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:51 devstack sudo[99953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765 1073741824
Nov 02 10:14:51 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:51 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c 1G" returned: 0 in 0.588s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Downloaded image 8597227a-8c6f-4093-bfe1-6fee00454944 ((None, [{'url': 'file:///opt/stack/data/glance/images/8597227a-8c6f-4093-bfe1-6fee00454944', 'metadata': {}}])) to volume 158c7b8d-9ee9-4c1c-be2a-1c9331d2053c successfully. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Temporary image 8597227a-8c6f-4093-bfe1-6fee00454944 for user e894fb1f0c02423f92c663de9264c1fa is deleted. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Marking volume 158c7b8d-9ee9-4c1c-be2a-1c9331d2053c as bootable. {{(pid=87014) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Copying metadata from image 8597227a-8c6f-4093-bfe1-6fee00454944 to 158c7b8d-9ee9-4c1c-be2a-1c9331d2053c. {{(pid=87014) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Creating volume glance metadata for volume 158c7b8d-9ee9-4c1c-be2a-1c9331d2053c backed by image 8597227a-8c6f-4093-bfe1-6fee00454944 with: {'image_id': '8597227a-8c6f-4093-bfe1-6fee00454944', 'image_name': 'tempest-scenario-img--210125307', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87014) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 02 10:14:51 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c" returned: 0 in 0.646s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:51 devstack sudo[99958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c
Nov 02 10:14:51 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5528b2-417f-4b30-931e-8652d23f0e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c', 'volume_size': 1, 'image_id': '8597227a-8c6f-4093-bfe1-6fee00454944', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8597227a-8c6f-4093-bfe1-6fee00454944', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--210125307', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '893cbb1fbce44e0d82b05724d353e532', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8597227a-8c6f-4093-bfe1-6fee00454944', 'created_at': datetime.datetime(2026, 11, 2, 9, 14, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 14, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8597227a-8c6f-4093-bfe1-6fee00454944/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f06a420>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7c8bc5-d559-4392-82c6-d616222e9312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Flow 'volume_create_manager' (c20765d3-80d1-4497-939a-077ec5175abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7683d3ea-7f34-44a6-ae45-8324690f2c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:51 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Volume volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c (158c7b8d-9ee9-4c1c-be2a-1c9331d2053c): created successfully
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7c8bc5-d559-4392-82c6-d616222e9312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Flow 'volume_create_manager' (bb35cfc3-7076-4718-aea4-70f97e33074d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7683d3ea-7f34-44a6-ae45-8324690f2c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1905791093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b180ee97-604a-4b08-afe8-befd000b2fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf569521506d4520b86f5ab11a837507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:52Z,use_quota=True,user_id='54cec8c23ee84d4f9ea05e1845426755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde250af-3c72-40b3-8215-8e2c8d8af066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde250af-3c72-40b3-8215-8e2c8d8af066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c472203e-2431-4869-8048-e73e0c16179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c472203e-2431-4869-8048-e73e0c16179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b180ee97-604a-4b08-afe8-befd000b2fd2', 'volume_name': 'volume-b180ee97-604a-4b08-afe8-befd000b2fd2', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a00d95b-580a-45a4-8143-ef2cd5c4ad06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a00d95b-580a-45a4-8143-ef2cd5c4ad06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db11dc57-f05d-4b6b-8daf-d6d6866ab2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:52 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Volume b180ee97-604a-4b08-afe8-befd000b2fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b180ee97-604a-4b08-afe8-befd000b2fd2', 'volume_size': 1}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-919a9482-ce04-4e22-8b7f-e31a0bc93b76 tempest-TestInstancesWithCinderVolumes-254229861 None] Created volume successfully.
Nov 02 10:14:52 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84a3d46d-550b-4595-93c4-baf3b84c045c" returned: 0 in 0.537s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Lock "cinder-quobyte-84a3d46d-550b-4595-93c4-baf3b84c045c" released by "delete_volume" :: held 1.250s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:52 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765 1073741824" returned: 0 in 0.921s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Created reservations ['3d871454-624b-4da8-8f90-0254366b2368', 'a1355856-9709-470b-8240-0553c014bedc', '49f8dbfc-957e-43bd-ae27-f8bb79c90c11', '7974abcd-3b20-4f32-919d-a3f696aa99b7'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:52 devstack sudo[99966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765
Nov 02 10:14:52 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:52 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:14:52 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:52 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765" returned: 0 in 0.351s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1905791093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b180ee97-604a-4b08-afe8-befd000b2fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf569521506d4520b86f5ab11a837507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:52Z,use_quota=True,user_id='54cec8c23ee84d4f9ea05e1845426755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Creating volume b180ee97-604a-4b08-afe8-befd000b2fd2 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:52 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:52 devstack sudo[99972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2 1073741824
Nov 02 10:14:52 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c7fd53-0aba-4da1-b351-3ce8d09a491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-804df60e-ddb0-40d6-b855-84c8c2882765', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:52 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08e50df-4368-4617-ac33-82cd3ba1db1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.383s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:14:52 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Volume volume-804df60e-ddb0-40d6-b855-84c8c2882765 (804df60e-ddb0-40d6-b855-84c8c2882765): created successfully
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08e50df-4368-4617-ac33-82cd3ba1db1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Flow 'volume_create_manager' (64aa83ae-82e0-4d2b-87e8-de02de6c8ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Deleted volume successfully.
Nov 02 10:14:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0fa5ea76-5e4e-474d-b12e-81cde611367e tempest-CreateVolumesFromImageTest-954670223 None] Created volume successfully.
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Flow 'volume_create_manager' (f1d80783-0d1d-44c0-8bc1-dc363088c6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb663e2-aa42-41c7-b41a-94ebfe018b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-97d6b67c-9a6f-4723-9c94-4dcd3ae2a389 tempest-VolumesTransfersV357Test-69913052 None] Lock "cinder-84a3d46d-550b-4595-93c4-baf3b84c045c-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb663e2-aa42-41c7-b41a-94ebfe018b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1960398629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832d4909-90e7-439c-a63e-cdcf36d502d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf569521506d4520b86f5ab11a837507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:53Z,use_quota=True,user_id='54cec8c23ee84d4f9ea05e1845426755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b1d999-0cc6-49c9-a40f-aefce776f612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b1d999-0cc6-49c9-a40f-aefce776f612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed86472-3945-4cbe-a289-42a6ad27374c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed86472-3945-4cbe-a289-42a6ad27374c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832d4909-90e7-439c-a63e-cdcf36d502d0', 'volume_name': 'volume-832d4909-90e7-439c-a63e-cdcf36d502d0', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594ab78f-a6ad-4b64-967f-ae2d09717f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594ab78f-a6ad-4b64-967f-ae2d09717f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e086fd0-3c0e-45a1-8367-3863163fbc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:53 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Volume 832d4909-90e7-439c-a63e-cdcf36d502d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832d4909-90e7-439c-a63e-cdcf36d502d0', 'volume_size': 1}
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:53 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2 1073741824" returned: 0 in 1.131s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:54 devstack sudo[100030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2
Nov 02 10:14:54 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Flow 'volume_create_manager' (b0e65dc0-d678-4a3a-b7e4-aba19eb370ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2b4284-56ee-4fab-a5bf-c9bd10504a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2b4284-56ee-4fab-a5bf-c9bd10504a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1860939010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b784e362-9fa9-4b0d-bc5c-b25d53bb5699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf569521506d4520b86f5ab11a837507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:54Z,use_quota=True,user_id='54cec8c23ee84d4f9ea05e1845426755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e281884-f920-4ea8-b76d-0b6ec0a3acca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e281884-f920-4ea8-b76d-0b6ec0a3acca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e46239-740a-43c2-8e24-31537dd456c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e46239-740a-43c2-8e24-31537dd456c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b784e362-9fa9-4b0d-bc5c-b25d53bb5699', 'volume_name': 'volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cee59bd-df77-4327-889d-08e56fce00ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cee59bd-df77-4327-889d-08e56fce00ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6728cb22-6c2e-4606-9e15-58389a99f373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:54 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Volume b784e362-9fa9-4b0d-bc5c-b25d53bb5699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699', 'volume_size': 1}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:54 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2" returned: 0 in 0.520s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.299s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1960398629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832d4909-90e7-439c-a63e-cdcf36d502d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf569521506d4520b86f5ab11a837507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:53Z,use_quota=True,user_id='54cec8c23ee84d4f9ea05e1845426755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Creating volume 832d4909-90e7-439c-a63e-cdcf36d502d0 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:54 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db11dc57-f05d-4b6b-8daf-d6d6866ab2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b180ee97-604a-4b08-afe8-befd000b2fd2', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:54 devstack sudo[100042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0 1073741824
Nov 02 10:14:54 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbddea3-5233-4898-bb87-3a6171096dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:54 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Volume volume-b180ee97-604a-4b08-afe8-befd000b2fd2 (b180ee97-604a-4b08-afe8-befd000b2fd2): created successfully
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbddea3-5233-4898-bb87-3a6171096dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Flow 'volume_create_manager' (c20765d3-80d1-4497-939a-077ec5175abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:54 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d6ec6c3c-0e40-44bb-ac5b-7940be31caf6 tempest-CreateVolumesFromImageTest-954670223 None] Created volume successfully.
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Flow 'volume_create_manager' (01f03cd7-0c6e-40b9-b4f3-8559e46e08bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c0be14-987f-45a0-901d-25a26cdc019b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c0be14-987f-45a0-901d-25a26cdc019b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1550517533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe586af-86b0-4007-8566-e4b1c35b9318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbbde45bef344dfbcb60da5867bbecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:55Z,use_quota=True,user_id='b42922f67ff14678adf3a6cb6ea30d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cf1506-cf02-4db1-935a-dfcd564a938d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cf1506-cf02-4db1-935a-dfcd564a938d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3935eb2-8eec-4d6b-8b05-6e5a2bcd0c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3935eb2-8eec-4d6b-8b05-6e5a2bcd0c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe586af-86b0-4007-8566-e4b1c35b9318', 'volume_name': 'volume-cfe586af-86b0-4007-8566-e4b1c35b9318', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d21583-2ad3-489b-85ae-4d10cdceffdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d21583-2ad3-489b-85ae-4d10cdceffdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8e62ea-4560-4f18-a4d7-c43814970ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:55 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Volume cfe586af-86b0-4007-8566-e4b1c35b9318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe586af-86b0-4007-8566-e4b1c35b9318', 'volume_size': 1}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Flow 'volume_create_manager' (7614cb35-f441-44e1-8df2-70a3955020a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2337462-73b3-4d35-ae85-b2703bcdfcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2337462-73b3-4d35-ae85-b2703bcdfcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1317233799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac9d140-af25-4ded-94dd-168ebf901b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf569521506d4520b86f5ab11a837507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:56Z,use_quota=True,user_id='54cec8c23ee84d4f9ea05e1845426755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdacd91-2a79-4c00-82a9-df6bb3017797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdacd91-2a79-4c00-82a9-df6bb3017797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af42dff8-2ed4-4424-8968-4adad15b25a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af42dff8-2ed4-4424-8968-4adad15b25a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac9d140-af25-4ded-94dd-168ebf901b06', 'volume_name': 'volume-1ac9d140-af25-4ded-94dd-168ebf901b06', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a439e0d-a9d6-4d57-8c2e-eda0e2ec09f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a439e0d-a9d6-4d57-8c2e-eda0e2ec09f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc6f115-1795-423d-9098-e84f490bfae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:55 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Volume 1ac9d140-af25-4ded-94dd-168ebf901b06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac9d140-af25-4ded-94dd-168ebf901b06', 'volume_size': 1}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:55 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0 1073741824" returned: 0 in 1.380s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:56 devstack sudo[100060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0
Nov 02 10:14:56 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:56 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0" returned: 0 in 0.387s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.968s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1860939010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b784e362-9fa9-4b0d-bc5c-b25d53bb5699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf569521506d4520b86f5ab11a837507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:54Z,use_quota=True,user_id='54cec8c23ee84d4f9ea05e1845426755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Creating volume b784e362-9fa9-4b0d-bc5c-b25d53bb5699 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:56 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e086fd0-3c0e-45a1-8367-3863163fbc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832d4909-90e7-439c-a63e-cdcf36d502d0', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:56 devstack sudo[100069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699 1073741824
Nov 02 10:14:56 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc38c15-1fd3-4ccb-a956-763e408f6562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:56 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Volume volume-832d4909-90e7-439c-a63e-cdcf36d502d0 (832d4909-90e7-439c-a63e-cdcf36d502d0): created successfully
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc38c15-1fd3-4ccb-a956-763e408f6562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Flow 'volume_create_manager' (f1d80783-0d1d-44c0-8bc1-dc363088c6c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:56 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fdc30d91-ab78-4afe-af16-e112ed09633f tempest-CreateVolumesFromImageTest-954670223 None] Created volume successfully.
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d9ec279-47a0-41f9-ab59-5d9385a47974 tempest-VolumesActionsTest-1152702528 None] Acquiring lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" by "attach_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d9ec279-47a0-41f9-ab59-5d9385a47974 tempest-VolumesActionsTest-1152702528 None] Lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" acquired by "attach_volume" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:56 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9d9ec279-47a0-41f9-ab59-5d9385a47974 tempest-VolumesActionsTest-1152702528 None] Attaching volume c8315302-bb0e-4721-8ffd-65da6fd9b1cc to instance 0821e9c2-ba90-413d-a82e-4833faaf5856 at mountpoint /dev/vdb on host None.
Nov 02 10:14:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9d9ec279-47a0-41f9-ab59-5d9385a47974 tempest-VolumesActionsTest-1152702528 None] Attach volume completed successfully.
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d9ec279-47a0-41f9-ab59-5d9385a47974 tempest-VolumesActionsTest-1152702528 None] Lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" released by "attach_volume" :: held 0.169s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:57 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699 1073741824" returned: 0 in 0.898s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:57 devstack sudo[100075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699
Nov 02 10:14:57 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ff66861-2c97-47e9-b420-231cec15fa1d tempest-VolumesActionsTest-1152702528 None] Acquiring lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc-detach_volume" by "detach_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ff66861-2c97-47e9-b420-231cec15fa1d tempest-VolumesActionsTest-1152702528 None] Lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:14:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3ff66861-2c97-47e9-b420-231cec15fa1d tempest-VolumesActionsTest-1152702528 None] Detaching volume c8315302-bb0e-4721-8ffd-65da6fd9b1cc from instance 0821e9c2-ba90-413d-a82e-4833faaf5856.
Nov 02 10:14:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3ff66861-2c97-47e9-b420-231cec15fa1d tempest-VolumesActionsTest-1152702528 None] Detach volume completed successfully.
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ff66861-2c97-47e9-b420-231cec15fa1d tempest-VolumesActionsTest-1152702528 None] Lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:14:57 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699" returned: 0 in 0.550s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.231s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1550517533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe586af-86b0-4007-8566-e4b1c35b9318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbbde45bef344dfbcb60da5867bbecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:55Z,use_quota=True,user_id='b42922f67ff14678adf3a6cb6ea30d54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Creating volume cfe586af-86b0-4007-8566-e4b1c35b9318 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:57 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6728cb22-6c2e-4606-9e15-58389a99f373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:58 devstack sudo[100078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318 1073741824
Nov 02 10:14:58 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8fb745-505d-4173-b31f-5b87d5336390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:58 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Volume volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699 (b784e362-9fa9-4b0d-bc5c-b25d53bb5699): created successfully
Nov 02 10:14:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8fb745-505d-4173-b31f-5b87d5336390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Flow 'volume_create_manager' (b0e65dc0-d678-4a3a-b7e4-aba19eb370ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:58 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9e3d98c8-5afe-4f7d-9318-50819d0e04eb tempest-CreateVolumesFromImageTest-954670223 None] Created volume successfully.
Nov 02 10:14:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ceda626a-589c-4228-9ffe-dea8d59aa8ac req-58dd760a-f023-42c0-a4bd-4c5403317613 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:58 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318 1073741824" returned: 0 in 0.854s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:58 devstack sudo[100107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318
Nov 02 10:14:58 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:59 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318" returned: 0 in 0.388s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.478s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1317233799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac9d140-af25-4ded-94dd-168ebf901b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf569521506d4520b86f5ab11a837507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:14:56Z,use_quota=True,user_id='54cec8c23ee84d4f9ea05e1845426755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Creating volume 1ac9d140-af25-4ded-94dd-168ebf901b06 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:14:59 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8e62ea-4560-4f18-a4d7-c43814970ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe586af-86b0-4007-8566-e4b1c35b9318', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02687a9-2e96-40a9-9ea3-b36b7e80d578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:14:59 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Volume volume-cfe586af-86b0-4007-8566-e4b1c35b9318 (cfe586af-86b0-4007-8566-e4b1c35b9318): created successfully
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02687a9-2e96-40a9-9ea3-b36b7e80d578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:14:59 devstack sudo[100119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06 1073741824
Nov 02 10:14:59 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:14:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Flow 'volume_create_manager' (01f03cd7-0c6e-40b9-b4f3-8559e46e08bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:14:59 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0a81a069-29f7-4776-92d6-5da77f0d40ff tempest-VolumesTransfersV357Test-304920484 None] Created volume successfully.
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Acquiring lock "cinder-cfe586af-86b0-4007-8566-e4b1c35b9318-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:00 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Lock "cinder-cfe586af-86b0-4007-8566-e4b1c35b9318-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06 1073741824" returned: 0 in 0.932s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Acquiring lock "cinder-quobyte-cfe586af-86b0-4007-8566-e4b1c35b9318" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:00 devstack sudo[100126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06
Nov 02 10:15:00 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Lock "cinder-quobyte-cfe586af-86b0-4007-8566-e4b1c35b9318" acquired by "delete_volume" :: waited 0.030s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf19151e-3f0a-4c8f-b2b8-3d353b5353dd]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:00 devstack sudo[100128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318
Nov 02 10:15:00 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:00 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06" returned: 0 in 0.517s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ceda626a-589c-4228-9ffe-dea8d59aa8ac req-58dd760a-f023-42c0-a4bd-4c5403317613 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.160s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc6f115-1795-423d-9098-e84f490bfae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac9d140-af25-4ded-94dd-168ebf901b06', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3acf086-8af3-490b-83f9-84a618bcada2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-ceda626a-589c-4228-9ffe-dea8d59aa8ac req-58dd760a-f023-42c0-a4bd-4c5403317613 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:01 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Volume volume-1ac9d140-af25-4ded-94dd-168ebf901b06 (1ac9d140-af25-4ded-94dd-168ebf901b06): created successfully
Nov 02 10:15:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3acf086-8af3-490b-83f9-84a618bcada2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Flow 'volume_create_manager' (7614cb35-f441-44e1-8df2-70a3955020a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:15:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2b6f5e6b-2089-4f93-a8f5-dcf123bd7578 tempest-CreateVolumesFromImageTest-954670223 None] Created volume successfully.
Nov 02 10:15:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-ceda626a-589c-4228-9ffe-dea8d59aa8ac req-58dd760a-f023-42c0-a4bd-4c5403317613 tempest-TestInstancesWithCinderVolumes-254229861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bea192e1-d3f9-42e4-8ad1-011ca80e20b7', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:15:01 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318" returned: 0 in 0.644s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:01 devstack sudo[100136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318
Nov 02 10:15:01 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-ceda626a-589c-4228-9ffe-dea8d59aa8ac req-58dd760a-f023-42c0-a4bd-4c5403317613 tempest-TestInstancesWithCinderVolumes-254229861 None] attachment_update completed successfully.
Nov 02 10:15:01 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cfe586af-86b0-4007-8566-e4b1c35b9318" returned: 0 in 0.617s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Lock "cinder-quobyte-cfe586af-86b0-4007-8566-e4b1c35b9318" released by "delete_volume" :: held 1.354s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:01 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Created reservations ['51a9f8e3-def3-4f40-9fe4-6f7cd8446f08', 'aa54fea4-bc3f-4003-bef0-0aa5cc719d91', '58d2beaf-14d3-4cc3-897e-1d4893ec9da8', 'aeee8173-d9d1-4166-8db1-e9e1e7d3bfab'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:02 devstack sudo[100145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:15:02 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "cinder-1ac9d140-af25-4ded-94dd-168ebf901b06-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-1ac9d140-af25-4ded-94dd-168ebf901b06-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "cinder-quobyte-1ac9d140-af25-4ded-94dd-168ebf901b06" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-quobyte-1ac9d140-af25-4ded-94dd-168ebf901b06" acquired by "delete_volume" :: waited 0.050s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:02 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.562s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:15:02 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Deleted volume successfully.
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f44c214-19f0-4053-b255-7dff26375099]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2aa48e56-383c-45a2-a2bd-c2c0fe54784c tempest-VolumesTransfersV357Test-69913052 None] Lock "cinder-cfe586af-86b0-4007-8566-e4b1c35b9318-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:02 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06
Nov 02 10:15:02 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:03 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06" returned: 0 in 0.904s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:03 devstack sudo[100605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06
Nov 02 10:15:03 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:04 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1ac9d140-af25-4ded-94dd-168ebf901b06" returned: 0 in 0.519s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-quobyte-1ac9d140-af25-4ded-94dd-168ebf901b06" released by "delete_volume" :: held 1.553s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:04 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Created reservations ['57619237-7748-48e9-801d-13013aae80cb', '02e111fc-02aa-4c1a-904e-db3f81a797ac', 'cf275357-b940-482f-94ba-fd7722474746', 'b0a9433c-d8ce-4d18-a8aa-0b088f0ee3ec'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:15:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:15:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:15:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:04 devstack sudo[100636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:15:04 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "cinder-b784e362-9fa9-4b0d-bc5c-b25d53bb5699-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-b784e362-9fa9-4b0d-bc5c-b25d53bb5699-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "cinder-quobyte-b784e362-9fa9-4b0d-bc5c-b25d53bb5699" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-quobyte-b784e362-9fa9-4b0d-bc5c-b25d53bb5699" acquired by "delete_volume" :: waited 0.061s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[544a1b9f-a7de-41f2-813d-bea32c4a6e0f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:05 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.634s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:05 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:15:05 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Deleted volume successfully.
Nov 02 10:15:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-277c4ec8-24df-4f8d-9549-2a96f7a83452 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-1ac9d140-af25-4ded-94dd-168ebf901b06-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:05 devstack sudo[100639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699
Nov 02 10:15:05 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:05 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699" returned: 0 in 0.670s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:05 devstack sudo[100646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699
Nov 02 10:15:05 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:06 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b784e362-9fa9-4b0d-bc5c-b25d53bb5699" returned: 0 in 0.703s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-quobyte-b784e362-9fa9-4b0d-bc5c-b25d53bb5699" released by "delete_volume" :: held 1.481s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:06 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Created reservations ['9155ba9e-7f05-4be0-a53d-59a8fd0db770', '653bb390-2b16-46c0-94f2-317d0b1ab48c', 'a13adf1c-09a7-410f-809d-183d48080948', 'eae60e78-aec6-4950-b205-21e8b4bb0fc6'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:15:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa0cff-9186-4c6c-97cd-13129a9ab100]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:07 devstack sudo[100649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc
Nov 02 10:15:07 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:07 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:15:07 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:07 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:15:07 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:07 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "cinder-832d4909-90e7-439c-a63e-cdcf36d502d0-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.601s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:15:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Deleted volume successfully.
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-832d4909-90e7-439c-a63e-cdcf36d502d0-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72187533-6d24-4bc6-bdad-8770f3fa6c93 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-b784e362-9fa9-4b0d-bc5c-b25d53bb5699-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=93,cinder:UPDATE=113,cinder:DELETE=13,cinder:INSERT=28 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "cinder-quobyte-832d4909-90e7-439c-a63e-cdcf36d502d0" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-quobyte-832d4909-90e7-439c-a63e-cdcf36d502d0" acquired by "delete_volume" :: waited 0.049s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[02daa028-7e1e-4af9-8418-f73ff3d408a1]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:08 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.788s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:08 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" returned: 0 in 1.151s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4049540-94f6-4c03-8ded-7ba7fbfbf9e9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:08 devstack sudo[100660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0
Nov 02 10:15:08 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:08 devstack sudo[100661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc
Nov 02 10:15:08 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:08 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0" returned: 0 in 0.920s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:09 devstack sudo[100671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0
Nov 02 10:15:09 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:09 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" returned: 0 in 1.000s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.fa318ad7-b35b-4011-bdd3-5dd74f333b90bm1aqit5.img {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:09 devstack sudo[100673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.fa318ad7-b35b-4011-bdd3-5dd74f333b90bm1aqit5.img
Nov 02 10:15:09 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:09 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-832d4909-90e7-439c-a63e-cdcf36d502d0" returned: 0 in 0.938s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-quobyte-832d4909-90e7-439c-a63e-cdcf36d502d0" released by "delete_volume" :: held 1.999s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:10 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Created reservations ['be3ee8de-61cb-4398-af91-5e445c0021f7', '0d9fbf72-440b-44ce-a188-f10566d4059f', '7f6868f4-692c-407e-b5ee-644188fade8d', '9b92fc0c-b682-4e11-b572-d6e89bba619c'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:15:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:15:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:15:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:10 devstack sudo[100686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:15:10 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "cinder-b180ee97-604a-4b08-afe8-befd000b2fd2-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-b180ee97-604a-4b08-afe8-befd000b2fd2-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:12 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 1.429s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:12 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:15:12 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Deleted volume successfully.
Nov 02 10:15:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dd7c87c8-bf69-4857-833d-7e11f5081207 tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-832d4909-90e7-439c-a63e-cdcf36d502d0-delete_volume" released by "delete_volume" :: held 4.607s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "cinder-quobyte-b180ee97-604a-4b08-afe8-befd000b2fd2" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-quobyte-b180ee97-604a-4b08-afe8-befd000b2fd2" acquired by "delete_volume" :: waited 0.101s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:12 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbf9fb6-68bf-4431-acc2-28fa6be57ade]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:13 devstack sudo[100701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2
Nov 02 10:15:13 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:14 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2" returned: 0 in 2.113s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:14 devstack sudo[100729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2
Nov 02 10:15:14 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:15 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b180ee97-604a-4b08-afe8-befd000b2fd2" returned: 0 in 0.804s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-quobyte-b180ee97-604a-4b08-afe8-befd000b2fd2" released by "delete_volume" :: held 3.089s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:15 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Created reservations ['e442ea51-ab89-4375-8acf-64f101193b8c', '739cd3bc-ca34-4496-963c-70986ac07091', 'd04b1af8-9e63-4177-a527-aaf1f9e3adfb', '7ac76f14-aadb-438e-a15f-4949f0a8b825'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:15:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:15:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:15:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:16 devstack sudo[100736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:15:16 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:17 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.836s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:17 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:15:17 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Deleted volume successfully.
Nov 02 10:15:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12af1e70-1478-4430-b6d3-03e707f5eeae tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-b180ee97-604a-4b08-afe8-befd000b2fd2-delete_volume" released by "delete_volume" :: held 5.065s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "cinder-804df60e-ddb0-40d6-b855-84c8c2882765-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-804df60e-ddb0-40d6-b855-84c8c2882765-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "cinder-quobyte-804df60e-ddb0-40d6-b855-84c8c2882765" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-quobyte-804df60e-ddb0-40d6-b855-84c8c2882765" acquired by "delete_volume" :: waited 0.058s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:17 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf4f261-2ad0-4e95-8f62-f333637ebe89]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:18 devstack sudo[100739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765
Nov 02 10:15:18 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:19 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765" returned: 0 in 1.409s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:19 devstack sudo[100745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765
Nov 02 10:15:19 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:20 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-804df60e-ddb0-40d6-b855-84c8c2882765" returned: 0 in 1.043s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-quobyte-804df60e-ddb0-40d6-b855-84c8c2882765" released by "delete_volume" :: held 2.686s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:20 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Created reservations ['a2e0b290-1f23-49a1-a88c-1ef6403e2d6e', 'eda87285-558d-4dfe-a70a-b399cc65dcb5', 'ba460bd0-08a8-4437-853e-491a7b3d37d8', '7def079d-5c64-449b-b7f3-5e9ece97587e'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:15:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:15:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:15:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:21 devstack sudo[100748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:15:21 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:22 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 1.317s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:22 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:15:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Deleted volume successfully.
Nov 02 10:15:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4c008a0a-13c3-4015-ae6d-9e55d6e9128f tempest-CreateVolumesFromImageTest-954670223 None] Lock "cinder-804df60e-ddb0-40d6-b855-84c8c2882765-delete_volume" released by "delete_volume" :: held 4.866s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:22 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.fa318ad7-b35b-4011-bdd3-5dd74f333b90bm1aqit5.img" returned: 0 in 13.844s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:22 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa2c252-2af5-465e-8b69-d24ae5bde033]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:23 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc
Nov 02 10:15:23 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:24 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" returned: 0 in 1.073s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:24 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc, size 1024.00 MB, duration 13.85 sec, destination /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.fa318ad7-b35b-4011-bdd3-5dd74f333b90bm1aqit5.img {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:15:24 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] Converted 1024.00 MB image at 73.96 MB/s
Nov 02 10:15:24 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] fa318ad7-b35b-4011-bdd3-5dd74f333b90 was raw, no need to convert to raw {{(pid=87014) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 02 10:15:31 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:15:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Flow 'volume_create_manager' (4de829a5-619c-46f0-b1de-b9179b8c113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:15:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f841ae-d67d-4d44-b4e3-fbabb44ccf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f841ae-d67d-4d44-b4e3-fbabb44ccf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892076c4-0616-46b0-a057-b66de14738d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d67c3569bf64eaab86a360ebba0aab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:32Z,use_quota=True,user_id='bce168219c7b489182a19e52e0c6d9b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9081eb-886f-4eb0-b768-39b7fe57c5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9081eb-886f-4eb0-b768-39b7fe57c5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6176514-a327-4996-a325-8b9191e559ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:31 devstack cinder-volume[87014]: DEBUG cinder.image.glance [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Creating Keystone auth plugin from conf {{(pid=87014) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 02 10:15:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6176514-a327-4996-a325-8b9191e559ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '892076c4-0616-46b0-a057-b66de14738d4', 'volume_name': 'volume-892076c4-0616-46b0-a057-b66de14738d4', 'volume_size': 1, 'image_id': 'e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b226d1ee2b2f6f996478b3341b1a8381', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d67c3569bf64eaab86a360ebba0aab5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cbb7dbd0b0910160b3a118321edb12bf0b3890aba2523069e2fa2122d3ca72b2f349ca13d82e0af5dc82cab0dbc7160ba5a48ab3c90e7202f7901fcc8c44b337', 'id': 'e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'created_at': datetime.datetime(2026, 11, 2, 9, 15, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 15, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8a31cd7-3d00-413b-ada9-187b0ecbefcb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0b2840>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4583470c-be68-408c-9daf-b7543b5d4416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4583470c-be68-408c-9daf-b7543b5d4416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f77c765-a195-40d4-82a0-cb166683db8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:32 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Volume 892076c4-0616-46b0-a057-b66de14738d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-892076c4-0616-46b0-a057-b66de14738d4', 'volume_size': 1, 'image_id': 'e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b226d1ee2b2f6f996478b3341b1a8381', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d67c3569bf64eaab86a360ebba0aab5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cbb7dbd0b0910160b3a118321edb12bf0b3890aba2523069e2fa2122d3ca72b2f349ca13d82e0af5dc82cab0dbc7160ba5a48ab3c90e7202f7901fcc8c44b337', 'id': 'e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'created_at': datetime.datetime(2026, 11, 2, 9, 15, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 15, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8a31cd7-3d00-413b-ada9-187b0ecbefcb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0b2840>}
Nov 02 10:15:32 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Trying to clone 892076c4-0616-46b0-a057-b66de14738d4 from image e8a31cd7-3d00-413b-ada9-187b0ecbefcb at location (None, [{'url': 'file:///opt/stack/data/glance/images/e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'metadata': {}}]). {{(pid=87014) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 02 10:15:32 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 02 10:15:32 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Image download 0.00 MB at 0.00 MB/s
Nov 02 10:15:32 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a149cf5-ae50-4a70-a6c8-b2d20a22ee99]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:32 devstack sudo[100796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD
Nov 02 10:15:32 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:33 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD" returned: 0 in 0.638s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:33 devstack sudo[100800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD
Nov 02 10:15:33 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:33 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD" returned: 1 in 0.598s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:15:33 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Temporary image e8a31cd7-3d00-413b-ada9-187b0ecbefcb is fetched for user bce168219c7b489182a19e52e0c6d9b4. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 02 10:15:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[919ff8db-443f-490f-ade0-bdc3b631ce70]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:34 devstack sudo[100805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD
Nov 02 10:15:34 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:34 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD" returned: 0 in 0.597s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:34 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD
Nov 02 10:15:34 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:34 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD" returned: 1 in 0.520s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:15:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-2fad344e-def6-41c9-8f89-000141dd3925 req-452709b0-1cef-452f-8149-833534e1f837 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:43 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:UPDATE=97,cinder:SELECT=89,cinder:INSERT=27,cinder:DELETE=5 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Flow 'volume_create_manager' (38931ec2-9f09-4e50-b020-7a8dbadef085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42bc522-7cd6-4c81-860d-e3ce526f0b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42bc522-7cd6-4c81-860d-e3ce526f0b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1869528412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbc1376-21cf-4c15-9432-9cdd3d6352c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f6fbb95394076ae34887a5113f8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:45Z,use_quota=True,user_id='bd5cdfa16320453d902c351f14dfa143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d27a593-5f11-4a7b-8b54-afafd7b84048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d27a593-5f11-4a7b-8b54-afafd7b84048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224c9354-5c52-4f93-a188-9d37fde4c64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224c9354-5c52-4f93-a188-9d37fde4c64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcbc1376-21cf-4c15-9432-9cdd3d6352c4', 'volume_name': 'volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7162fbca-4662-4921-b910-74794dc2be94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7162fbca-4662-4921-b910-74794dc2be94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c282caa-5616-45f2-a8ce-3b8ca3bb43d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:44 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Volume fcbc1376-21cf-4c15-9432-9cdd3d6352c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4', 'volume_size': 1}
Nov 02 10:15:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.951s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] Uploaded volume to glance image-id: fa318ad7-b35b-4011-bdd3-5dd74f333b90. {{(pid=87014) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.819s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892076c4-0616-46b0-a057-b66de14738d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d67c3569bf64eaab86a360ebba0aab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:32Z,use_quota=True,user_id='bce168219c7b489182a19e52e0c6d9b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Creating volume 892076c4-0616-46b0-a057-b66de14738d4 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:15:49 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:15:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:49 devstack sudo[100841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4 1073741824
Nov 02 10:15:49 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:49 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-338163d8-eaa0-4806-b80e-e58af1e1990e tempest-VolumesActionsTest-1152702528 None] Copy volume to image completed successfully.
Nov 02 10:15:50 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4 1073741824" returned: 0 in 0.453s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:50 devstack sudo[100847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4
Nov 02 10:15:50 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:50 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4" returned: 0 in 0.266s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-2fad344e-def6-41c9-8f89-000141dd3925 req-452709b0-1cef-452f-8149-833534e1f837 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.098s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-2fad344e-def6-41c9-8f89-000141dd3925 req-452709b0-1cef-452f-8149-833534e1f837 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.928s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1869528412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcbc1376-21cf-4c15-9432-9cdd3d6352c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f6fbb95394076ae34887a5113f8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:15:45Z,use_quota=True,user_id='bd5cdfa16320453d902c351f14dfa143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Creating volume fcbc1376-21cf-4c15-9432-9cdd3d6352c4 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:15:50 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:50 devstack sudo[100850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 1073741824
Nov 02 10:15:50 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Attempting download of e8a31cd7-3d00-413b-ada9-187b0ecbefcb ((None, [{'url': 'file:///opt/stack/data/glance/images/e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'metadata': {}}])) to volume 892076c4-0616-46b0-a057-b66de14738d4. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-2fad344e-def6-41c9-8f89-000141dd3925 req-452709b0-1cef-452f-8149-833534e1f837 tempest-TestInstancesWithCinderVolumes-254229861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-aa35830a-9d1d-4894-8be1-2b169c725502', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f668a58-72ad-4d71-9f85-ba3e8caa3577', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a1275-e61e-40d8-8214-877a9b80c407]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_d_9cj9no {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-2fad344e-def6-41c9-8f89-000141dd3925 req-452709b0-1cef-452f-8149-833534e1f837 tempest-TestInstancesWithCinderVolumes-254229861 None] attachment_update completed successfully.
Nov 02 10:15:50 devstack sudo[100852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_d_9cj9no
Nov 02 10:15:50 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:51 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 1073741824" returned: 0 in 0.633s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:51 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_d_9cj9no" returned: 0 in 0.537s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_d_9cj9no {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:51 devstack sudo[100863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4
Nov 02 10:15:51 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:51 devstack sudo[100862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_d_9cj9no
Nov 02 10:15:51 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:51 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4" returned: 0 in 0.339s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.069s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c282caa-5616-45f2-a8ce-3b8ca3bb43d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9385684-3ecf-4270-b9cd-be79283e8bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:51 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32ed5f5-c029-43c8-9112-b158af8e234e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_d_9cj9no" returned: 1 in 0.432s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_d_9cj9no' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c764e1d7-d7e9-4a62-88e6-55cd3e21e9ff]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:51 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Volume volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 (fcbc1376-21cf-4c15-9432-9cdd3d6352c4): created successfully
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9385684-3ecf-4270-b9cd-be79283e8bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Flow 'volume_create_manager' (38931ec2-9f09-4e50-b020-7a8dbadef085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:15:51 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-cc6f5d7c-c468-4b4a-9e42-aeedaa1f40d3 tempest-VolumesSnapshotTestJSON-164813266 None] Created volume successfully.
Nov 02 10:15:51 devstack sudo[100869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc
Nov 02 10:15:51 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:51 devstack sudo[100870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD
Nov 02 10:15:51 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:52 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:52 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" returned: 0 in 0.389s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c42c8d9-d85e-43c0-a389-c9493133ab0a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:52 devstack sudo[100878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD
Nov 02 10:15:52 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:52 devstack sudo[100879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc
Nov 02 10:15:52 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:52 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] e8a31cd7-3d00-413b-ada9-187b0ecbefcb was raw, converting to qcow2 {{(pid=87014) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:52 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4
Nov 02 10:15:52 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:52 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" returned: 0 in 0.482s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:52 devstack sudo[100894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img
Nov 02 10:15:52 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:53 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4" returned: 0 in 0.771s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:53 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e8a31cd7-3d00-413b-ada9-187b0ecbefcb_2lw3w33_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:15:53 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Converted 0.00 MB image at 0.00 MB/s
Nov 02 10:15:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:53 devstack sudo[100914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4 1G
Nov 02 10:15:53 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:54 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4 1G" returned: 0 in 1.182s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:54 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Downloaded image e8a31cd7-3d00-413b-ada9-187b0ecbefcb ((None, [{'url': 'file:///opt/stack/data/glance/images/e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'metadata': {}}])) to volume 892076c4-0616-46b0-a057-b66de14738d4 successfully. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 02 10:15:54 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Temporary image e8a31cd7-3d00-413b-ada9-187b0ecbefcb for user bce168219c7b489182a19e52e0c6d9b4 is deleted. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 02 10:15:54 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Marking volume 892076c4-0616-46b0-a057-b66de14738d4 as bootable. {{(pid=87014) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 02 10:15:54 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Copying metadata from image e8a31cd7-3d00-413b-ada9-187b0ecbefcb to 892076c4-0616-46b0-a057-b66de14738d4. {{(pid=87014) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 02 10:15:54 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Creating volume glance metadata for volume 892076c4-0616-46b0-a057-b66de14738d4 backed by image e8a31cd7-3d00-413b-ada9-187b0ecbefcb with: {'image_id': 'e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b226d1ee2b2f6f996478b3341b1a8381', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87014) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 02 10:15:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-03c2ff20-4a1b-4b87-a29c-6a2f5fea76c4 req-bc3a810b-3d84-477c-8faa-536f25472c80 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f77c765-a195-40d4-82a0-cb166683db8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892076c4-0616-46b0-a057-b66de14738d4', 'volume_size': 1, 'image_id': 'e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b226d1ee2b2f6f996478b3341b1a8381', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d67c3569bf64eaab86a360ebba0aab5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cbb7dbd0b0910160b3a118321edb12bf0b3890aba2523069e2fa2122d3ca72b2f349ca13d82e0af5dc82cab0dbc7160ba5a48ab3c90e7202f7901fcc8c44b337', 'id': 'e8a31cd7-3d00-413b-ada9-187b0ecbefcb', 'created_at': datetime.datetime(2026, 11, 2, 9, 15, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 15, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8a31cd7-3d00-413b-ada9-187b0ecbefcb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0b2840>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e77e97d-e190-4d8b-b233-f91140cf21b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:15:54 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Volume volume-892076c4-0616-46b0-a057-b66de14738d4 (892076c4-0616-46b0-a057-b66de14738d4): created successfully
Nov 02 10:15:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e77e97d-e190-4d8b-b233-f91140cf21b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:15:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Flow 'volume_create_manager' (4de829a5-619c-46f0-b1de-b9179b8c113d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:15:54 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-7b44eccf-c742-4a58-a5c4-76b4516a5b28 tempest-VolumeImageDependencyTests-2116334780 None] Created volume successfully.
Nov 02 10:15:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Acquiring lock "cinder-892076c4-0616-46b0-a057-b66de14738d4-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Lock "cinder-892076c4-0616-46b0-a057-b66de14738d4-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Acquiring lock "cinder-quobyte-892076c4-0616-46b0-a057-b66de14738d4" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:15:55 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Lock "cinder-quobyte-892076c4-0616-46b0-a057-b66de14738d4" acquired by "delete_volume" :: waited 0.046s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:15:55 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb72232-530c-4ca7-b323-3765ea751b70]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:15:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:56 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4
Nov 02 10:15:56 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:56 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4" returned: 0 in 0.593s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:56 devstack sudo[100941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4
Nov 02 10:15:56 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:57 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-892076c4-0616-46b0-a057-b66de14738d4" returned: 0 in 0.468s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Lock "cinder-quobyte-892076c4-0616-46b0-a057-b66de14738d4" released by "delete_volume" :: held 1.183s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:57 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Created reservations ['524a4bcd-d1e2-46f0-837d-654e72ea8e42', 'f3bdc033-9b37-4533-8dc0-fc406aa441ef', 'a26cb39c-20a2-4413-a1e5-81201ae8a98f', '1732dbec-1d5d-4939-997a-f8fba396491c'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:15:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:15:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:15:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:15:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:15:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:15:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:15:57 devstack sudo[100944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:15:57 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:15:57 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root
Nov 02 10:15:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.404s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:15:57 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:15:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Deleted volume successfully.
Nov 02 10:15:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ff83c067-b82a-4425-8f8d-0237a8bc1659 tempest-VolumeImageDependencyTests-2116334780 None] Lock "cinder-892076c4-0616-46b0-a057-b66de14738d4-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:15:59 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img" returned: 0 in 7.418s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:00 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e1ebe2-9528-432e-a2e0-38d4a4245ea2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:00 devstack sudo[100948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc
Nov 02 10:16:00 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:00 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" returned: 0 in 0.591s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:00 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc, size 1024.00 MB, duration 7.42 sec, destination /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:16:00 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Converted 1024.00 MB image at 138.02 MB/s
Nov 02 10:16:00 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] 5aba1780-a0ec-4747-918d-bc38bdae9b36 was raw, converting to qcow2 {{(pid=87014) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 02 10:16:00 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25275f3-e03b-4bd3-9fb1-49d319b64709]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:00 devstack sudo[100954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img
Nov 02 10:16:00 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:01 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img" returned: 0 in 0.381s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:01 devstack sudo[100958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img
Nov 02 10:16:01 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:01 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img" returned: 1 in 0.345s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:16:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img /opt/stack/data/cinder/conversion/vol_upload_x6x9mqv9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:01 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img /opt/stack/data/cinder/conversion/vol_upload_x6x9mqv9
Nov 02 10:16:01 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:01 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img /opt/stack/data/cinder/conversion/vol_upload_x6x9mqv9" returned: 0 in 0.267s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:01 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Image conversion details: src /opt/stack/data/cinder/conversion/c8315302-bb0e-4721-8ffd-65da6fd9b1cc.temp_image.5aba1780-a0ec-4747-918d-bc38bdae9b36dp17_94d.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_x6x9mqv9 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:16:01 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 02 10:16:01 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9324a735-0383-4ed5-afe0-2fd2f3a1d0a4]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x6x9mqv9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:01 devstack sudo[100969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x6x9mqv9
Nov 02 10:16:01 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:02 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x6x9mqv9" returned: 0 in 0.388s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.085s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Uploaded volume to glance image-id: 5aba1780-a0ec-4747-918d-bc38bdae9b36. {{(pid=87014) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 02 10:16:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.176s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] Creating offline snapshot 029bd91b-97a8-403b-853e-2cfa8b8d13fc of volume fcbc1376-21cf-4c15-9432-9cdd3d6352c4 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:16:03 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-164c10b0-0e24-4f09-bccf-4284e682011c tempest-VolumesActionsTest-1152702528 None] Copy volume to image completed successfully.
Nov 02 10:16:03 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acd3cff-71b9-4811-9b3d-2461a77d0f16]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:03 devstack sudo[100975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4
Nov 02 10:16:03 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:04 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4" returned: 0 in 0.406s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:04 devstack sudo[100980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc 1G
Nov 02 10:16:04 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:04 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc 1G" returned: 0 in 0.546s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:04 devstack sudo[100988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc
Nov 02 10:16:04 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:05 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc" returned: 0 in 0.356s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:05 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc is being set with open permissions: ugo+rw
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Acquiring lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:05 devstack sudo[100993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc
Nov 02 10:16:05 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Acquiring lock "cinder-quobyte-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Lock "cinder-quobyte-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" acquired by "delete_volume" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ac9bc3-eb14-40a4-957a-d501dc655c2a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:05 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc
Nov 02 10:16:05 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:05 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc" returned: 0 in 0.385s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:05 devstack sudo[100998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.info
Nov 02 10:16:05 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:05 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" returned: 0 in 0.481s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:05 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:05 devstack sudo[101004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc
Nov 02 10:16:05 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.info" returned: 0 in 0.311s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:05 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.info is being set with open permissions: ugo+rw
Nov 02 10:16:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:05 devstack sudo[101006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.info
Nov 02 10:16:05 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:06 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" returned: 0 in 0.282s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Lock "cinder-quobyte-c8315302-bb0e-4721-8ffd-65da6fd9b1cc" released by "delete_volume" :: held 0.840s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:06 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.info" returned: 0 in 0.290s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.418s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-03c2ff20-4a1b-4b87-a29c-6a2f5fea76c4 req-bc3a810b-3d84-477c-8faa-536f25472c80 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.530s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-03c2ff20-4a1b-4b87-a29c-6a2f5fea76c4 req-bc3a810b-3d84-477c-8faa-536f25472c80 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Created reservations ['37b1b262-0631-4947-b992-0315fa17c6e7', '3c5e88ef-9960-4dad-a8df-adc87e41202a', 'a4e24662-fc5a-4cb6-8ed8-c7319b4a17da', 'cda0b0b2-e01d-4e63-90a0-09152731beec'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-03c2ff20-4a1b-4b87-a29c-6a2f5fea76c4 req-bc3a810b-3d84-477c-8faa-536f25472c80 tempest-TestInstancesWithCinderVolumes-254229861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-20d90e23-78b3-49ca-876d-741eb90f4812', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc0ba4c8-ba9f-4721-9bbe-8b49c7bb8e43', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:16:06 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6df4bad1-5519-4ec4-8a1f-951c20d77cc4 tempest-VolumesSnapshotTestJSON-164813266 None] Create snapshot completed successfully
Nov 02 10:16:06 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-03c2ff20-4a1b-4b87-a29c-6a2f5fea76c4 req-bc3a810b-3d84-477c-8faa-536f25472c80 tempest-TestInstancesWithCinderVolumes-254229861 None] attachment_update completed successfully.
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:06 devstack sudo[101010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:16:06 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:06 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.452s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-029bd91b-97a8-403b-853e-2cfa8b8d13fc-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:06 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Deleted volume successfully.
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-029bd91b-97a8-403b-853e-2cfa8b8d13fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ff28254-1b97-46e2-af23-082b42076a77 tempest-VolumesActionsTest-1152702528 None] Lock "cinder-c8315302-bb0e-4721-8ffd-65da6fd9b1cc-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-fcbc1376-21cf-4c15-9432-9cdd3d6352c4" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-fcbc1376-21cf-4c15-9432-9cdd3d6352c4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-029bd91b-97a8-403b-853e-2cfa8b8d13fc" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-029bd91b-97a8-403b-853e-2cfa8b8d13fc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Deleting offline snapshot 029bd91b-97a8-403b-853e-2cfa8b8d13fc of volume fcbc1376-21cf-4c15-9432-9cdd3d6352c4 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] snapshot_file for this snap is: volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[355763b1-610a-4479-8bd3-a05b19c87017]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:07 devstack sudo[101015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc
Nov 02 10:16:07 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:07 devstack sudo[101017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:16:07 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:07 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc" returned: 0 in 0.526s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[578fbd40-8d69-4463-ae60-a708a1a83cd6]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:07 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.469s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:16:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:16:07 devstack sudo[101023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4
Nov 02 10:16:07 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:08 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4" returned: 0 in 0.479s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:08 devstack sudo[101036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc
Nov 02 10:16:08 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:08 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc" returned: 0 in 0.446s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:08 devstack sudo[101043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc
Nov 02 10:16:08 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:08 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4.029bd91b-97a8-403b-853e-2cfa8b8d13fc" returned: 0 in 0.319s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:08 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=67,cinder:INSERT=15,cinder:UPDATE=48,cinder:DELETE=3 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:16:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-029bd91b-97a8-403b-853e-2cfa8b8d13fc" released by "_delete_snapshot" :: held 1.959s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-fcbc1376-21cf-4c15-9432-9cdd3d6352c4" released by "delete_snapshot" :: held 1.999s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:09 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Created reservations ['87d49b7d-260d-409d-b6da-e5a9d9c33958', '617abc77-8277-4828-a3d0-800a3a0c24e8', 'b497def5-2877-4104-b153-88af30078309', 'bb165d39-3290-4ccd-9bff-286af53e32ae'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:16:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Delete snapshot completed successfully.
Nov 02 10:16:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c98f0c75-50e8-4a78-b94e-2bcf98cb8e6c tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-029bd91b-97a8-403b-853e-2cfa8b8d13fc-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Flow 'volume_create_manager' (20582e75-8ed7-454e-b84e-12f6aaa3aa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e73ddc1-e29e-45bf-bebe-da18dfb9cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e73ddc1-e29e-45bf-bebe-da18dfb9cd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1067725038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579c51ae-048e-407c-a891-3001dfc6bb68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f6fbb95394076ae34887a5113f8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:11Z,use_quota=True,user_id='bd5cdfa16320453d902c351f14dfa143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58392c3-810e-497f-be61-acd599a1b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58392c3-810e-497f-be61-acd599a1b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527e1e9e-d9ee-44a7-b500-4303f99fb752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527e1e9e-d9ee-44a7-b500-4303f99fb752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '579c51ae-048e-407c-a891-3001dfc6bb68', 'volume_name': 'volume-579c51ae-048e-407c-a891-3001dfc6bb68', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330b5187-be4d-48d7-b9a2-984d6482ee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330b5187-be4d-48d7-b9a2-984d6482ee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec39ef4-5402-497b-9974-573c6709beb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:10 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Volume 579c51ae-048e-407c-a891-3001dfc6bb68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-579c51ae-048e-407c-a891-3001dfc6bb68', 'volume_size': 1}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1067725038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579c51ae-048e-407c-a891-3001dfc6bb68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f6fbb95394076ae34887a5113f8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:11Z,use_quota=True,user_id='bd5cdfa16320453d902c351f14dfa143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Creating volume 579c51ae-048e-407c-a891-3001dfc6bb68 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:16:10 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:16:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:10 devstack sudo[101047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 1073741824
Nov 02 10:16:10 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:11 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 1073741824" returned: 0 in 0.708s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:11 devstack sudo[101065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68
Nov 02 10:16:11 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:12 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68" returned: 0 in 0.356s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:16:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec39ef4-5402-497b-9974-573c6709beb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-579c51ae-048e-407c-a891-3001dfc6bb68', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01603b07-fcd7-45cf-bcbb-b91547819ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:12 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Volume volume-579c51ae-048e-407c-a891-3001dfc6bb68 (579c51ae-048e-407c-a891-3001dfc6bb68): created successfully
Nov 02 10:16:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01603b07-fcd7-45cf-bcbb-b91547819ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:12 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Flow 'volume_create_manager' (20582e75-8ed7-454e-b84e-12f6aaa3aa89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:12 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-662011e8-eb11-4351-a4dc-2d2d90f03ebf tempest-VolumesSnapshotTestJSON-164813266 None] Created volume successfully.
Nov 02 10:16:13 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-d3a8db6b-a8cc-46ff-ab12-08314e677c0f req-0b86465a-9cbf-4d65-be14-cbd70462a5d5 tempest-TestInstancesWithCinderVolumes-254229861 None] Terminate volume connection completed successfully.
Nov 02 10:16:13 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-d3a8db6b-a8cc-46ff-ab12-08314e677c0f req-0b86465a-9cbf-4d65-be14-cbd70462a5d5 tempest-TestInstancesWithCinderVolumes-254229861 None] Deleting attachment 7f668a58-72ad-4d71-9f85-ba3e8caa3577. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:16:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] Creating offline snapshot 1077d587-e45a-409d-8f4d-170d87505b5e of volume 579c51ae-048e-407c-a891-3001dfc6bb68 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:16:13 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba402fde-c3db-46c3-a779-2cc46d51bb61]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:13 devstack sudo[101079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68
Nov 02 10:16:13 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:13 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68" returned: 0 in 0.561s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:13 devstack sudo[101085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e 1G
Nov 02 10:16:13 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "cinder-aa35830a-9d1d-4894-8be1-2b169c725502-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-aa35830a-9d1d-4894-8be1-2b169c725502-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "cinder-quobyte-aa35830a-9d1d-4894-8be1-2b169c725502" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-quobyte-aa35830a-9d1d-4894-8be1-2b169c725502" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:14 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f587a164-394b-4d9b-a73d-e12cc194f932]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:14 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502
Nov 02 10:16:14 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:14 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e 1G" returned: 0 in 0.802s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579c51ae-048e-407c-a891-3001dfc6bb68 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:14 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579c51ae-048e-407c-a891-3001dfc6bb68 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e
Nov 02 10:16:14 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:14 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502" returned: 0 in 0.768s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:15 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502
Nov 02 10:16:15 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:15 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579c51ae-048e-407c-a891-3001dfc6bb68 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e" returned: 0 in 0.487s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:15 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e is being set with open permissions: ugo+rw
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:15 devstack sudo[101108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e
Nov 02 10:16:15 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:15 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-aa35830a-9d1d-4894-8be1-2b169c725502" returned: 0 in 0.328s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-quobyte-aa35830a-9d1d-4894-8be1-2b169c725502" released by "delete_volume" :: held 1.184s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:15 devstack cinder-volume[87014]: WARNING cinder.quota [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1349351476-549813991 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1349351476-549813991, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:16:15 devstack cinder-volume[87014]: WARNING cinder.quota [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1349351476-549813991 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1349351476-549813991, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Created reservations ['5e039a37-3808-4a76-8120-6cb35555c513', 'ab6cb26a-9294-4c96-9829-b3be798afd6e', '26a2f3bb-7176-4112-aca4-9e11ee93b550', 'a1cfb063-947c-4c63-bfbd-5090d1c87994'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:15 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:15 devstack sudo[101111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:16:15 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e" returned: 0 in 0.400s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:15 devstack sudo[101113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.info
Nov 02 10:16:15 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:15 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.435s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:15 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:16:16 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Deleted volume successfully.
Nov 02 10:16:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3248c14a-2f1d-4332-b076-f6a956a1aa85 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-aa35830a-9d1d-4894-8be1-2b169c725502-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:16 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.info" returned: 0 in 0.525s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:16 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.info is being set with open permissions: ugo+rw
Nov 02 10:16:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:16 devstack sudo[101151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.info
Nov 02 10:16:16 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:16 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.info" returned: 0 in 0.505s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.456s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:16 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2c13570c-9e23-4578-9f79-68d6c6824fe4 tempest-VolumesSnapshotTestJSON-164813266 None] Create snapshot completed successfully
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Flow 'volume_create_manager' (99ad0b26-7564-4b79-bcd5-b00bb040cbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b0d58d-cfcd-4595-9283-6bdb463b46af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b0d58d-cfcd-4595-9283-6bdb463b46af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1763899316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dea6a78-e332-4138-9af0-3d9852ce27da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b56b13f683d47a3984b1a3ea8c4042f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:17Z,use_quota=True,user_id='cb585ab044d7430b92cf218cce61561f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f41f10e-8400-4d84-81d2-db64eb5218a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f41f10e-8400-4d84-81d2-db64eb5218a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f18b2d-5442-49ad-b5db-2047694a8579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f18b2d-5442-49ad-b5db-2047694a8579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dea6a78-e332-4138-9af0-3d9852ce27da', 'volume_name': 'volume-7dea6a78-e332-4138-9af0-3d9852ce27da', 'volume_size': 2}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279975b3-efb3-40a9-ad78-0e40d024c38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279975b3-efb3-40a9-ad78-0e40d024c38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf5acdb-b3d3-4c85-b5cf-855110f5a23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:17 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Volume 7dea6a78-e332-4138-9af0-3d9852ce27da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dea6a78-e332-4138-9af0-3d9852ce27da', 'volume_size': 2}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1763899316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dea6a78-e332-4138-9af0-3d9852ce27da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b56b13f683d47a3984b1a3ea8c4042f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:17Z,use_quota=True,user_id='cb585ab044d7430b92cf218cce61561f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Creating volume 7dea6a78-e332-4138-9af0-3d9852ce27da {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:16:17 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:16:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da 2147483648 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:17 devstack sudo[101162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da 2147483648
Nov 02 10:16:17 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:18 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da 2147483648" returned: 0 in 0.711s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:18 devstack sudo[101185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da
Nov 02 10:16:18 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Flow 'volume_create_manager' (bd15c412-3117-4d6f-9e04-e4991513ecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108b9e20-8444-4c94-b0da-c0849d1c4814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108b9e20-8444-4c94-b0da-c0849d1c4814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1710758727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5c9c56-e843-4ca2-a1ec-6ef4638845cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f6fbb95394076ae34887a5113f8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1077d587-e45a-409d-8f4d-170d87505b5e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:18Z,use_quota=True,user_id='bd5cdfa16320453d902c351f14dfa143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407101cd-bbf5-410b-9f5c-86a9c2849eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407101cd-bbf5-410b-9f5c-86a9c2849eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c728997-0155-4ab9-8e12-eb72b4fcd004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c728997-0155-4ab9-8e12-eb72b4fcd004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c5c9c56-e843-4ca2-a1ec-6ef4638845cb', 'volume_name': 'volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb', 'volume_size': 2, 'snapshot_id': '1077d587-e45a-409d-8f4d-170d87505b5e'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (909beb5b-0616-4070-96ce-a81d33f340a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (909beb5b-0616-4070-96ce-a81d33f340a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f8c840-40f2-460d-aaef-b8f2ed57efd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:18 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Volume 9c5c9c56-e843-4ca2-a1ec-6ef4638845cb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb', 'volume_size': 2, 'snapshot_id': '1077d587-e45a-409d-8f4d-170d87505b5e'}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:18 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da" returned: 0 in 0.331s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.141s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-1077d587-e45a-409d-8f4d-170d87505b5e-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" by "_create_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf5acdb-b3d3-4c85-b5cf-855110f5a23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dea6a78-e332-4138-9af0-3d9852ce27da', 'volume_size': 2}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f97dcc-78b1-4c2a-a967-3cbb5a56b2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-1077d587-e45a-409d-8f4d-170d87505b5e-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Creating volume 9c5c9c56-e843-4ca2-a1ec-6ef4638845cb from snapshot 1077d587-e45a-409d-8f4d-170d87505b5e {{(pid=87014) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:18 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Volume volume-7dea6a78-e332-4138-9af0-3d9852ce27da (7dea6a78-e332-4138-9af0-3d9852ce27da): created successfully
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f97dcc-78b1-4c2a-a967-3cbb5a56b2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Flow 'volume_create_manager' (99ad0b26-7564-4b79-bcd5-b00bb040cbdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] snapshot: 1077d587-e45a-409d-8f4d-170d87505b5e, volume: 9c5c9c56-e843-4ca2-a1ec-6ef4638845cb,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:16:18 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-37eb01e4-f312-41c8-910d-646b85780e3d tempest-VolumesCloneNegativeTest-797727975 None] Created volume successfully.
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3ac444-d30d-445c-9f97-06b0d032873b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:18 devstack sudo[101189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e
Nov 02 10:16:18 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-0711b418-7044-48ef-8099-28256cfda99f req-c50eaa8e-8819-4d06-85d2-5533797aa5d9 tempest-TestInstancesWithCinderVolumes-254229861 None] Terminate volume connection completed successfully.
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-0711b418-7044-48ef-8099-28256cfda99f req-c50eaa8e-8819-4d06-85d2-5533797aa5d9 tempest-TestInstancesWithCinderVolumes-254229861 None] Deleting attachment dc0ba4c8-ba9f-4721-9bbe-8b49c7bb8e43. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:16:19 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e" returned: 0 in 0.458s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-579c51ae-048e-407c-a891-3001dfc6bb68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97279ef-203b-43a0-bf2d-8605af154489]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:19 devstack sudo[101196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68
Nov 02 10:16:19 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Acquiring lock "cinder-7dea6a78-e332-4138-9af0-3d9852ce27da-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Lock "cinder-7dea6a78-e332-4138-9af0-3d9852ce27da-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Acquiring lock "cinder-quobyte-7dea6a78-e332-4138-9af0-3d9852ce27da" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Lock "cinder-quobyte-7dea6a78-e332-4138-9af0-3d9852ce27da" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:19 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68" returned: 0 in 0.484s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e813c1-103a-4d8e-b009-15bb422e8b03]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:19 devstack sudo[101202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb
Nov 02 10:16:19 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "cinder-20d90e23-78b3-49ca-876d-741eb90f4812-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:19 devstack sudo[101203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da
Nov 02 10:16:19 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-20d90e23-78b3-49ca-876d-741eb90f4812-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "cinder-quobyte-20d90e23-78b3-49ca-876d-741eb90f4812" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-quobyte-20d90e23-78b3-49ca-876d-741eb90f4812" acquired by "delete_volume" :: waited 0.034s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:20 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a789bdf-4d53-4341-b13f-10d12961e615]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:20 devstack sudo[101208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812
Nov 02 10:16:20 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:20 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da" returned: 0 in 0.522s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:20 devstack sudo[101214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da
Nov 02 10:16:20 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:20 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812" returned: 0 in 0.665s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:20 devstack sudo[101226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812
Nov 02 10:16:20 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:21 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-20d90e23-78b3-49ca-876d-741eb90f4812" returned: 0 in 0.450s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:21 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7dea6a78-e332-4138-9af0-3d9852ce27da" returned: 0 in 0.940s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-quobyte-20d90e23-78b3-49ca-876d-741eb90f4812" released by "delete_volume" :: held 1.216s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Lock "cinder-quobyte-7dea6a78-e332-4138-9af0-3d9852ce27da" released by "delete_volume" :: held 1.579s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:21 devstack cinder-volume[87014]: WARNING cinder.quota [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1403865409-1814933539 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1403865409-1814933539, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:16:21 devstack cinder-volume[87014]: WARNING cinder.quota [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1403865409-1814933539 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1403865409-1814933539, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Created reservations ['b7796132-daf1-4ea1-87b6-d7fb39d7996e', '91a5f492-a5ab-4ea3-9040-eade46681808', '146c79a8-4c75-4d86-b7f4-141761ad4e32', 'ec7bf585-8b52-4c92-a95d-d90bceb9edef'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Created reservations ['cce983f2-bc53-42eb-bac7-886bdd649cee', 'ecac9ae6-7225-4019-8e1b-b20254ae8c3e', '93fc00d0-d298-4f94-9e4e-57e598304c5c', 'b0966119-1576-45f0-b382-df4c6bc1f3d9'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:21 devstack sudo[101230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:16:21 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:21 devstack sudo[101232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:16:21 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:22 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.576s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:22 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:16:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Deleted volume successfully.
Nov 02 10:16:22 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.790s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:22 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:16:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40653ceb-d768-487d-b94b-ff01355b7cf1 tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-20d90e23-78b3-49ca-876d-741eb90f4812-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Deleted volume successfully.
Nov 02 10:16:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b58b9a3f-8370-47c3-8c08-b70d606b37b8 tempest-VolumesCloneNegativeTest-797727975 None] Lock "cinder-7dea6a78-e332-4138-9af0-3d9852ce27da-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:30 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" returned: 0 in 10.423s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:30 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68, size 1024.00 MB, duration 10.42 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:16:30 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Converted 1024.00 MB image at 98.23 MB/s
Nov 02 10:16:30 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb is being set with open permissions: ugo+rw
Nov 02 10:16:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:30 devstack sudo[101264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb
Nov 02 10:16:30 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:30 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" returned: 0 in 0.454s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" released by "_copy_volume_from_snapshot" :: held 11.952s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-1077d587-e45a-409d-8f4d-170d87505b5e-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" released by "_create_volume_from_snapshot" :: held 12.082s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.126s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f8c840-40f2-460d-aaef-b8f2ed57efd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb', 'volume_size': 2, 'snapshot_id': '1077d587-e45a-409d-8f4d-170d87505b5e'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68706c27-8948-4436-9684-da4fe5cd549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:30 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Volume volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb (9c5c9c56-e843-4ca2-a1ec-6ef4638845cb): created successfully
Nov 02 10:16:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68706c27-8948-4436-9684-da4fe5cd549e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Flow 'volume_create_manager' (bd15c412-3117-4d6f-9e04-e4991513ecb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:30 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-a5113d6d-ff72-44b8-a17b-afa1a7baeae0 tempest-VolumesSnapshotTestJSON-164813266 None] Created volume successfully.
Nov 02 10:16:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" acquired by "delete_volume" :: waited 0.027s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:31 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b26938-60e9-4935-96b1-4617afc65c39]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:31 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-a3733cca-758a-406c-91a3-bebee3d072db req-a40958d1-7755-4b0f-9d41-c7ad68f6aeb0 tempest-TestInstancesWithCinderVolumes-254229861 None] Terminate volume connection completed successfully.
Nov 02 10:16:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-a3733cca-758a-406c-91a3-bebee3d072db req-a40958d1-7755-4b0f-9d41-c7ad68f6aeb0 tempest-TestInstancesWithCinderVolumes-254229861 None] Deleting attachment bea192e1-d3f9-42e4-8ad1-011ca80e20b7. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:16:31 devstack sudo[101268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb
Nov 02 10:16:31 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:31 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" returned: 0 in 0.640s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:32 devstack sudo[101273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb
Nov 02 10:16:32 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:32 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" returned: 0 in 0.434s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb" released by "delete_volume" :: held 1.167s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Created reservations ['25605d9a-3ed8-484c-be55-68fd7bdf83e4', '73a9d76c-6178-4781-9554-822d83f0e727', 'd8238ced-eaef-4ce2-aaae-9214e2726c08', '07cf58a4-122e-4c8a-9811-cd410733dbe4'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:32 devstack sudo[101276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:16:32 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:32 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.335s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "cinder-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:32 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Deleted volume successfully.
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-01397a64-bfe7-449e-ab94-55555d85edb7 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-9c5c9c56-e843-4ca2-a1ec-6ef4638845cb-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "cinder-quobyte-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-quobyte-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdf476c-9583-4ef8-a785-348e21e60a70]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:33 devstack sudo[101279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c
Nov 02 10:16:33 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-1077d587-e45a-409d-8f4d-170d87505b5e-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:33 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-1077d587-e45a-409d-8f4d-170d87505b5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-579c51ae-048e-407c-a891-3001dfc6bb68" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c" returned: 0 in 0.522s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-579c51ae-048e-407c-a891-3001dfc6bb68" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-1077d587-e45a-409d-8f4d-170d87505b5e" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:33 devstack sudo[101284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c
Nov 02 10:16:33 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-1077d587-e45a-409d-8f4d-170d87505b5e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Deleting offline snapshot 1077d587-e45a-409d-8f4d-170d87505b5e of volume 579c51ae-048e-407c-a891-3001dfc6bb68 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] snapshot_file for this snap is: volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Flow 'volume_create_manager' (8e48201d-ed3a-44cb-9100-393e5a040dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9efeb9-390b-4601-bfa2-46bdf7cc2ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb6ce3b-6242-464f-a1d3-2a5e7a5aa164]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9efeb9-390b-4601-bfa2-46bdf7cc2ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-822052398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e185d0-0a69-4819-8786-402db3bbd251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c10dc7758c14691abe444f0d986a427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:34Z,use_quota=True,user_id='49a94391347848d2885d71327cc04817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f846079d-e260-46cf-97e0-278468462580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f846079d-e260-46cf-97e0-278468462580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f30599-0115-4cf3-a28a-2590518ee07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.image.glance [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Creating Keystone auth plugin from conf {{(pid=87014) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 02 10:16:33 devstack sudo[101286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e
Nov 02 10:16:33 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:33 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c" returned: 0 in 0.346s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-quobyte-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c" released by "delete_volume" :: held 0.937s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:34 devstack cinder-volume[87014]: WARNING cinder.quota [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1889350255-75216497 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1889350255-75216497, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:16:34 devstack cinder-volume[87014]: WARNING cinder.quota [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1889350255-75216497 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1889350255-75216497, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Created reservations ['43c22655-38c3-4bc7-b1c9-a77a24415c69', '837b86fa-7a12-45b0-9e2d-3dd98294b1dc', '39223cc6-9a23-4cd0-b113-683add4caeeb', 'c0914ce1-03a7-46a6-9748-d71e0af41ce0'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f30599-0115-4cf3-a28a-2590518ee07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3e185d0-0a69-4819-8786-402db3bbd251', 'volume_name': 'volume-c3e185d0-0a69-4819-8786-402db3bbd251', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f392b9250>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684ae564-1ea1-4ed3-b6d7-3ddc0d34bdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684ae564-1ea1-4ed3-b6d7-3ddc0d34bdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8286dc17-7d8a-46f9-9c23-4b9cb3399516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:34 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Volume c3e185d0-0a69-4819-8786-402db3bbd251: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3e185d0-0a69-4819-8786-402db3bbd251', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f392b9250>}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Trying to clone c3e185d0-0a69-4819-8786-402db3bbd251 from image c35ca8ac-fc2e-4930-9230-8b67e658a8ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]). {{(pid=87014) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:34 devstack sudo[101295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:16:34 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:34 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e" returned: 0 in 0.567s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-579c51ae-048e-407c-a891-3001dfc6bb68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8756be0-9787-4c01-8218-04117ccfce94]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:34 devstack sudo[101297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68
Nov 02 10:16:34 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:34 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 02 10:16:34 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Image download 20.69 MB at 20.69 MB/s
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.431s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:16:34 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Deleted volume successfully.
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-341b4992-d078-4509-9a54-1acca8b3f4bb tempest-TestInstancesWithCinderVolumes-254229861 None] Lock "cinder-158c7b8d-9ee9-4c1c-be2a-1c9331d2053c-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2ac0e8-4f49-40f3-aea9-4e5149151521]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:34 devstack sudo[101301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD
Nov 02 10:16:34 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:35 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:35 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Temporary image c35ca8ac-fc2e-4930-9230-8b67e658a8ae is fetched for user 49a94391347848d2885d71327cc04817. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68" returned: 0 in 0.756s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:35 devstack sudo[101309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e
Nov 02 10:16:35 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[02906166-7897-4191-a549-354682ec6948]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:35 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD
Nov 02 10:16:35 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:35 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-822052398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e185d0-0a69-4819-8786-402db3bbd251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c10dc7758c14691abe444f0d986a427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:34Z,use_quota=True,user_id='49a94391347848d2885d71327cc04817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Creating volume c3e185d0-0a69-4819-8786-402db3bbd251 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:16:35 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:35 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e" returned: 0 in 0.645s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:35 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 1073741824
Nov 02 10:16:35 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:35 devstack sudo[101322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e
Nov 02 10:16:35 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:36 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68.1077d587-e45a-409d-8f4d-170d87505b5e" returned: 0 in 0.369s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-1077d587-e45a-409d-8f4d-170d87505b5e" released by "_delete_snapshot" :: held 2.577s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-579c51ae-048e-407c-a891-3001dfc6bb68" released by "delete_snapshot" :: held 2.625s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:36 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Created reservations ['a45830aa-900a-4b89-954d-88bd9d361fc5', '7332e03a-1e7d-4eb1-8aa6-1340ecd9d65e', 'f11ba0cf-de1e-4830-9367-28a6197a2344', '0f0f9a32-324a-4ce9-8150-1bf339a45cdd'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:16:36 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 1073741824" returned: 0 in 0.758s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Delete snapshot completed successfully.
Nov 02 10:16:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ba886e9d-05e1-4477-a0b4-33bbb0c3d9c6 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-1077d587-e45a-409d-8f4d-170d87505b5e-delete_snapshot" released by "delete_snapshot" :: held 2.939s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:36 devstack sudo[101330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251
Nov 02 10:16:36 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:36 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251" returned: 0 in 0.316s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:16:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:36 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Attempting download of c35ca8ac-fc2e-4930-9230-8b67e658a8ae ((None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}])) to volume c3e185d0-0a69-4819-8786-402db3bbd251. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6398aec6-d784-4bc9-9e6a-9c77b415c55b]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_v9e7lanc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-579c51ae-048e-407c-a891-3001dfc6bb68-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-579c51ae-048e-407c-a891-3001dfc6bb68-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-579c51ae-048e-407c-a891-3001dfc6bb68" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-579c51ae-048e-407c-a891-3001dfc6bb68" acquired by "delete_volume" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:37 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_v9e7lanc
Nov 02 10:16:37 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff6613a-53f9-4778-a862-25d901fb65a4]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:37 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68
Nov 02 10:16:37 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:37 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_v9e7lanc" returned: 0 in 0.464s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_v9e7lanc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:37 devstack sudo[101339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_v9e7lanc
Nov 02 10:16:37 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:37 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68" returned: 0 in 0.573s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:37 devstack sudo[101344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68
Nov 02 10:16:37 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:37 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_v9e7lanc" returned: 1 in 0.487s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_v9e7lanc' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd8d7bc-d588-4b32-a878-c224b488dad2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:38 devstack sudo[101348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD
Nov 02 10:16:38 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:38 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-579c51ae-048e-407c-a891-3001dfc6bb68" returned: 0 in 0.341s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-579c51ae-048e-407c-a891-3001dfc6bb68" released by "delete_volume" :: held 1.024s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Created reservations ['56ee73a3-e2bc-4176-879e-89c60dfa8ca9', '636e145e-b857-4a18-b1c4-0fa442fb1e96', '1365e930-652c-41c9-b0ff-231acfdf8914', 'aff747ce-dbde-4774-9efa-f0789196fbec'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:38 devstack sudo[101351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:16:38 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:38 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD" returned: 0 in 0.548s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] c35ca8ac-fc2e-4930-9230-8b67e658a8ae was qcow2, converting to qcow2 {{(pid=87014) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:38 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251
Nov 02 10:16:38 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:38 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.292s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:16:38 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Deleted volume successfully.
Nov 02 10:16:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5b05e214-7fc5-4219-bd50-3a2c6cf00e51 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-579c51ae-048e-407c-a891-3001dfc6bb68-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Flow 'volume_create_manager' (13995814-ec96-482c-b08a-df0b66ace938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa7cbb3-dc22-4078-9530-621ddf0f7076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa7cbb3-dc22-4078-9530-621ddf0f7076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-730577855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f094b0-43c8-44cf-8ec3-e61e415cb3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f6fbb95394076ae34887a5113f8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:40Z,use_quota=True,user_id='bd5cdfa16320453d902c351f14dfa143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c5a105-b7cf-47ac-adea-48b7fd48d153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c5a105-b7cf-47ac-adea-48b7fd48d153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a067f1e5-b583-42c9-918e-302bb0795620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a067f1e5-b583-42c9-918e-302bb0795620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f094b0-43c8-44cf-8ec3-e61e415cb3e1', 'volume_name': 'volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2695203-62ee-43bf-9e72-0bc2eaa47536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2695203-62ee-43bf-9e72-0bc2eaa47536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c22039c-7ab1-4665-86eb-42d8d3dd5827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:40 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Volume 96f094b0-43c8-44cf-8ec3-e61e415cb3e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1', 'volume_size': 1}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-730577855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f094b0-43c8-44cf-8ec3-e61e415cb3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f6fbb95394076ae34887a5113f8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:40Z,use_quota=True,user_id='bd5cdfa16320453d902c351f14dfa143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Creating volume 96f094b0-43c8-44cf-8ec3-e61e415cb3e1 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:16:40 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:40 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 1073741824
Nov 02 10:16:40 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:40 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 1073741824" returned: 0 in 0.683s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:41 devstack sudo[101374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1
Nov 02 10:16:41 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:41 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251" returned: 0 in 2.578s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_a85mxtd0devstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:16:41 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Converted 112.00 MB image at 43.42 MB/s
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:41 devstack sudo[101376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 1G
Nov 02 10:16:41 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:41 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" returned: 0 in 0.326s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c22039c-7ab1-4665-86eb-42d8d3dd5827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c3cc40-ead9-40ca-92ab-bee6f60aa105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:41 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Volume volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 (96f094b0-43c8-44cf-8ec3-e61e415cb3e1): created successfully
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c3cc40-ead9-40ca-92ab-bee6f60aa105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Flow 'volume_create_manager' (13995814-ec96-482c-b08a-df0b66ace938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-48900ff5-40af-4925-a56c-374d64b3cc97 tempest-VolumesSnapshotTestJSON-164813266 None] Created volume successfully.
Nov 02 10:16:41 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 1G" returned: 0 in 0.502s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Downloaded image c35ca8ac-fc2e-4930-9230-8b67e658a8ae ((None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}])) to volume c3e185d0-0a69-4819-8786-402db3bbd251 successfully. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Temporary image c35ca8ac-fc2e-4930-9230-8b67e658a8ae for user 49a94391347848d2885d71327cc04817 is deleted. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Marking volume c3e185d0-0a69-4819-8786-402db3bbd251 as bootable. {{(pid=87014) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Copying metadata from image c35ca8ac-fc2e-4930-9230-8b67e658a8ae to c3e185d0-0a69-4819-8786-402db3bbd251. {{(pid=87014) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Creating volume glance metadata for volume c3e185d0-0a69-4819-8786-402db3bbd251 backed by image c35ca8ac-fc2e-4930-9230-8b67e658a8ae with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87014) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8286dc17-7d8a-46f9-9c23-4b9cb3399516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e185d0-0a69-4819-8786-402db3bbd251', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f392b9250>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d616c0-3d9a-4a1a-80e2-9bd05f37869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:41 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Volume volume-c3e185d0-0a69-4819-8786-402db3bbd251 (c3e185d0-0a69-4819-8786-402db3bbd251): created successfully
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d616c0-3d9a-4a1a-80e2-9bd05f37869b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Flow 'volume_create_manager' (8e48201d-ed3a-44cb-9100-393e5a040dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2d3ff004-a060-4284-b637-19644ccaf6e9 tempest-VolumesExtendTest-66155195 None] Created volume successfully.
Nov 02 10:16:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] Creating offline snapshot 56707f17-35a0-43b1-98c4-b0a6a4c2c431 of volume 96f094b0-43c8-44cf-8ec3-e61e415cb3e1 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:16:42 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbfa98a-6b2c-4a28-8f62-5c1d40478dd9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6d1583e-5d58-4255-8c32-fd64371f13ad tempest-VolumesExtendTest-66155195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:42 devstack sudo[101384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1
Nov 02 10:16:42 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:43 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" returned: 0 in 0.574s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:43 devstack sudo[101389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431 1G
Nov 02 10:16:43 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:43 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431 1G" returned: 0 in 0.510s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:43 devstack sudo[101395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431
Nov 02 10:16:43 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:44 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431" returned: 0 in 0.351s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:44 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431 is being set with open permissions: ugo+rw
Nov 02 10:16:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:44 devstack sudo[101401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431
Nov 02 10:16:44 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:44 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431" returned: 0 in 0.361s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:44 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:UPDATE=108,cinder:SELECT=105,cinder:INSERT=36,cinder:DELETE=10 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:16:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:44 devstack sudo[101404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.info
Nov 02 10:16:44 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:44 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.info" returned: 0 in 0.348s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:44 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.info is being set with open permissions: ugo+rw
Nov 02 10:16:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:44 devstack sudo[101407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.info
Nov 02 10:16:44 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:45 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.info" returned: 0 in 0.317s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6d1583e-5d58-4255-8c32-fd64371f13ad tempest-VolumesExtendTest-66155195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.464s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:45 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e09cd92-ae1e-43fb-b53e-7660d399ae60]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6d1583e-5d58-4255-8c32-fd64371f13ad tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:45 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e1635a06-50a9-44ea-921d-552aa28b3b8b tempest-VolumesSnapshotTestJSON-164813266 None] Create snapshot completed successfully
Nov 02 10:16:45 devstack sudo[101411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251
Nov 02 10:16:45 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:45 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6d1583e-5d58-4255-8c32-fd64371f13ad tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251" returned: 0 in 0.521s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6d1583e-5d58-4255-8c32-fd64371f13ad tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 2G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6d1583e-5d58-4255-8c32-fd64371f13ad tempest-VolumesExtendTest-66155195 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 2G" returned: 0 in 0.131s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6d1583e-5d58-4255-8c32-fd64371f13ad tempest-VolumesExtendTest-66155195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.687s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:45 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-a6d1583e-5d58-4255-8c32-fd64371f13ad tempest-VolumesExtendTest-66155195 None] Extend volume completed successfully.
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Flow 'volume_create_manager' (1997527c-f864-4506-a90c-adb7cdc4db61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d8908f-18f7-4c1a-ab66-4fe9440aa3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d8908f-18f7-4c1a-ab66-4fe9440aa3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-72153591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cafce964-1cb4-49b9-b7c5-6e80bbda846c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f6fbb95394076ae34887a5113f8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=56707f17-35a0-43b1-98c4-b0a6a4c2c431,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:46Z,use_quota=True,user_id='bd5cdfa16320453d902c351f14dfa143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f48494f-224d-4758-be21-7b53a456c670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f48494f-224d-4758-be21-7b53a456c670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8650ff46-9c72-4abb-8d27-10b133fff33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8650ff46-9c72-4abb-8d27-10b133fff33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cafce964-1cb4-49b9-b7c5-6e80bbda846c', 'volume_name': 'volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c', 'volume_size': 1, 'snapshot_id': '56707f17-35a0-43b1-98c4-b0a6a4c2c431'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cf2b4f-1400-4d32-8c8e-43c33a77e791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cf2b4f-1400-4d32-8c8e-43c33a77e791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a87963-90cc-40ca-be2e-d7496d224a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Volume cafce964-1cb4-49b9-b7c5-6e80bbda846c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c', 'volume_size': 1, 'snapshot_id': '56707f17-35a0-43b1-98c4-b0a6a4c2c431'}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-56707f17-35a0-43b1-98c4-b0a6a4c2c431-cafce964-1cb4-49b9-b7c5-6e80bbda846c" by "_create_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-56707f17-35a0-43b1-98c4-b0a6a4c2c431-cafce964-1cb4-49b9-b7c5-6e80bbda846c" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Creating volume cafce964-1cb4-49b9-b7c5-6e80bbda846c from snapshot 56707f17-35a0-43b1-98c4-b0a6a4c2c431 {{(pid=87014) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-cafce964-1cb4-49b9-b7c5-6e80bbda846c" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-cafce964-1cb4-49b9-b7c5-6e80bbda846c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] snapshot: 56707f17-35a0-43b1-98c4-b0a6a4c2c431, volume: cafce964-1cb4-49b9-b7c5-6e80bbda846c,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Acquiring lock "cinder-c3e185d0-0a69-4819-8786-402db3bbd251-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[606e6bc7-7d79-4edf-a703-4b0daa97c071]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Lock "cinder-c3e185d0-0a69-4819-8786-402db3bbd251-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Acquiring lock "cinder-quobyte-c3e185d0-0a69-4819-8786-402db3bbd251" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Lock "cinder-quobyte-c3e185d0-0a69-4819-8786-402db3bbd251" acquired by "delete_volume" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad487760-e24c-4d78-b249-ccc756d864c2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:46 devstack sudo[101420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431
Nov 02 10:16:46 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:47 devstack sudo[101421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251
Nov 02 10:16:47 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:47 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431" returned: 0 in 0.558s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85df592-b4e4-4241-86a9-dcf0888764ed]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:47 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251" returned: 0 in 0.500s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:47 devstack sudo[101433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251
Nov 02 10:16:47 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:47 devstack sudo[101431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1
Nov 02 10:16:47 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:47 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c3e185d0-0a69-4819-8786-402db3bbd251" returned: 0 in 0.442s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:47 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" returned: 0 in 0.549s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Lock "cinder-quobyte-c3e185d0-0a69-4819-8786-402db3bbd251" released by "delete_volume" :: held 1.043s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:47 devstack sudo[101440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c
Nov 02 10:16:47 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:48 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Created reservations ['b25b7465-0ac6-43a3-a0d9-b2ae7a856b64', '52452979-d9da-4cde-b2bd-55dc9793c3c3', '5ef45dce-dbe6-4e7e-bea5-20dffbb346de', '88e4d119-e298-4688-afb3-ddccb3aa3115'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:16:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:48 devstack sudo[101442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:16:48 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:48 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.380s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:48 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:16:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Deleted volume successfully.
Nov 02 10:16:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4eda4dd6-645d-4637-a0cf-0a1d007a6507 tempest-VolumesExtendTest-66155195 None] Lock "cinder-c3e185d0-0a69-4819-8786-402db3bbd251-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Flow 'volume_create_manager' (fc9f2b9b-ab7b-48cc-8d75-4a6fa6f310d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf22469-97f9-4326-a0c7-b4e187aa089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf22469-97f9-4326-a0c7-b4e187aa089d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1818689157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed2ff92-588c-4c2e-91ee-f0b0b84bd931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c10dc7758c14691abe444f0d986a427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:50Z,use_quota=True,user_id='49a94391347848d2885d71327cc04817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8726f601-ff96-4b48-a2f1-ee36d5f1cdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8726f601-ff96-4b48-a2f1-ee36d5f1cdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f22aa4-190b-41b8-89c5-5cd96123ff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f22aa4-190b-41b8-89c5-5cd96123ff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed2ff92-588c-4c2e-91ee-f0b0b84bd931', 'volume_name': 'volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3408d5-f9db-4f24-ba1f-a1ca76e03510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3408d5-f9db-4f24-ba1f-a1ca76e03510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b84ef44-9053-40a5-b8c9-4e38c85038c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:50 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Volume 0ed2ff92-588c-4c2e-91ee-f0b0b84bd931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931', 'volume_size': 1}
Nov 02 10:16:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Flow 'volume_create_manager' (878d87c5-c3e7-4c59-942e-dc590798efaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17500b3-010c-49f4-972b-ae81d51b4c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17500b3-010c-49f4-972b-ae81d51b4c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1691182810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2564e7da034b64a2b0f0b16dc80585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:51Z,use_quota=True,user_id='63d939326c9e41b59297f29c7f0c6a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ffb16e-1035-4b96-afd0-8c2c7ae54de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ffb16e-1035-4b96-afd0-8c2c7ae54de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a138bf43-5877-4de1-ae07-f4968f8eed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a138bf43-5877-4de1-ae07-f4968f8eed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17', 'volume_name': 'volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43ee0cf-aa81-4ee1-9864-7f293265c6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43ee0cf-aa81-4ee1-9864-7f293265c6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fd2395-727b-4f4e-b216-c56af2782e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:51 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Volume 61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17', 'volume_size': 1}
Nov 02 10:16:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:56 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c" returned: 0 in 8.735s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:56 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1, size 1024.00 MB, duration 8.74 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:16:56 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Converted 1024.00 MB image at 117.20 MB/s
Nov 02 10:16:56 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c is being set with open permissions: ugo+rw
Nov 02 10:16:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:56 devstack sudo[101464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c
Nov 02 10:16:56 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:56 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c" returned: 0 in 0.279s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-cafce964-1cb4-49b9-b7c5-6e80bbda846c" released by "_copy_volume_from_snapshot" :: held 10.266s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-56707f17-35a0-43b1-98c4-b0a6a4c2c431-cafce964-1cb4-49b9-b7c5-6e80bbda846c" released by "_create_volume_from_snapshot" :: held 10.352s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.378s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.490s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1818689157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed2ff92-588c-4c2e-91ee-f0b0b84bd931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c10dc7758c14691abe444f0d986a427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:50Z,use_quota=True,user_id='49a94391347848d2885d71327cc04817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Creating volume 0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:16:57 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:57 devstack sudo[101467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 1073741824
Nov 02 10:16:57 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a87963-90cc-40ca-be2e-d7496d224a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c', 'volume_size': 1, 'snapshot_id': '56707f17-35a0-43b1-98c4-b0a6a4c2c431'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9dd445-aa6f-4a35-93e4-0b07e94c3cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:57 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Volume volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c (cafce964-1cb4-49b9-b7c5-6e80bbda846c): created successfully
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9dd445-aa6f-4a35-93e4-0b07e94c3cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Flow 'volume_create_manager' (1997527c-f864-4506-a90c-adb7cdc4db61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-15f0958f-147e-4501-bd67-3b44090cf765 tempest-VolumesSnapshotTestJSON-164813266 None] Created volume successfully.
Nov 02 10:16:57 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 1073741824" returned: 0 in 0.514s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:57 devstack sudo[101473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931
Nov 02 10:16:57 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-cafce964-1cb4-49b9-b7c5-6e80bbda846c-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-cafce964-1cb4-49b9-b7c5-6e80bbda846c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-cafce964-1cb4-49b9-b7c5-6e80bbda846c" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-cafce964-1cb4-49b9-b7c5-6e80bbda846c" acquired by "delete_volume" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e18f15f-94fc-4550-9695-db6fba0c30c4]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:57 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" returned: 0 in 0.378s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.484s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1691182810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2564e7da034b64a2b0f0b16dc80585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:16:51Z,use_quota=True,user_id='63d939326c9e41b59297f29c7f0c6a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Creating volume 61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:16:57 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:16:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:58 devstack sudo[101475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c
Nov 02 10:16:58 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b84ef44-9053-40a5-b8c9-4e38c85038c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567a7380-0595-4b02-b807-d6c74a6b006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:58 devstack sudo[101477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 1073741824
Nov 02 10:16:58 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:58 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Volume volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 (0ed2ff92-588c-4c2e-91ee-f0b0b84bd931): created successfully
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567a7380-0595-4b02-b807-d6c74a6b006f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Flow 'volume_create_manager' (fc9f2b9b-ab7b-48cc-8d75-4a6fa6f310d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:58 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-7187381c-a65e-4d7d-a5b6-442901f8e16f tempest-VolumesExtendTest-66155195 None] Created volume successfully.
Nov 02 10:16:58 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c" returned: 0 in 0.449s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:58 devstack sudo[101487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c
Nov 02 10:16:58 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:58 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 1073741824" returned: 0 in 0.522s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:58 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17
Nov 02 10:16:58 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:58 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cafce964-1cb4-49b9-b7c5-6e80bbda846c" returned: 0 in 0.286s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-cafce964-1cb4-49b9-b7c5-6e80bbda846c" released by "delete_volume" :: held 0.816s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Created reservations ['857576ab-e745-4933-b02c-6218b6cdf569', '87d49157-41e2-4970-a6f7-464f85c80092', '6f1eaf7f-5ed0-4934-b872-1552188c199a', '0ae6fc1a-883f-4f56-ae73-6023530adc05'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:58 devstack sudo[101494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:16:58 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:58 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" returned: 0 in 0.287s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fd2395-727b-4f4e-b216-c56af2782e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec924929-cd5d-4e43-8eb6-f605b4a2dcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:16:58 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Volume volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 (61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17): created successfully
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec924929-cd5d-4e43-8eb6-f605b4a2dcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Flow 'volume_create_manager' (878d87c5-c3e7-4c59-942e-dc590798efaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:16:58 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2f013918-56e2-4be4-b9c3-3b86c6c26697 tempest-SnapshotDependencyTests-511954894 None] Created volume successfully.
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-56707f17-35a0-43b1-98c4-b0a6a4c2c431-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-56707f17-35a0-43b1-98c4-b0a6a4c2c431-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-56707f17-35a0-43b1-98c4-b0a6a4c2c431" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-56707f17-35a0-43b1-98c4-b0a6a4c2c431" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Deleting offline snapshot 56707f17-35a0-43b1-98c4-b0a6a4c2c431 of volume 96f094b0-43c8-44cf-8ec3-e61e415cb3e1 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] snapshot_file for this snap is: volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d3a30b-4e83-4fe6-b3b1-246d57246786]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:59 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.380s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:16:59 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Deleted volume successfully.
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3f8544a9-11cc-41a5-b14d-ce05c377fceb tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-cafce964-1cb4-49b9-b7c5-6e80bbda846c-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:16:59 devstack sudo[101497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431
Nov 02 10:16:59 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] Creating offline snapshot 4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a of volume 61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a712cfba-54c3-45e8-a4c5-e057cca5a185]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:16:59 devstack sudo[101499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17
Nov 02 10:16:59 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:59 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431" returned: 0 in 0.573s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f16f24-12d7-4a09-9ebe-4c9d95f87092]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:59 devstack sudo[101504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1
Nov 02 10:16:59 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:16:59 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" returned: 0 in 0.430s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:16:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:16:59 devstack sudo[101509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a 1G
Nov 02 10:16:59 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:00 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" returned: 0 in 0.615s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:00 devstack sudo[101517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431
Nov 02 10:17:00 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:00 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a 1G" returned: 0 in 0.544s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:00 devstack sudo[101520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a
Nov 02 10:17:00 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:00 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a" returned: 0 in 0.320s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:00 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a is being set with open permissions: ugo+rw
Nov 02 10:17:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:00 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431" returned: 0 in 0.434s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:00 devstack sudo[101528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a
Nov 02 10:17:00 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:00 devstack sudo[101529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431
Nov 02 10:17:00 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:01 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a" returned: 0 in 0.296s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:01 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1.56707f17-35a0-43b1-98c4-b0a6a4c2c431" returned: 0 in 0.360s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:01 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.info
Nov 02 10:17:01 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-56707f17-35a0-43b1-98c4-b0a6a4c2c431" released by "_delete_snapshot" :: held 2.150s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" released by "delete_snapshot" :: held 2.177s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Created reservations ['56f65f29-efc4-46c0-90ec-e115d3b3f3c1', 'b63f847e-15b0-4d6e-8519-db5e794f257c', 'efa3c4d2-2cfb-42f9-a338-4a08a6cef012', 'feca782f-1c4b-475d-886a-66c32862bf0f'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:17:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Delete snapshot completed successfully.
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-48c4fb20-3f8c-4183-9dc1-91a26629ede9 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-56707f17-35a0-43b1-98c4-b0a6a4c2c431-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:01 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.info" returned: 0 in 0.331s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:01 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.info is being set with open permissions: ugo+rw
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:01 devstack sudo[101539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.info
Nov 02 10:17:01 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:01 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.info" returned: 0 in 0.315s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.284s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] Creating offline snapshot 97ee585f-66a3-4df9-8b5f-8711dc494795 of volume 0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:17:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-94a42c36-18f8-4d93-b017-f9e4ed3a3c40 tempest-SnapshotDependencyTests-511954894 None] Create snapshot completed successfully
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccfcaa5-dd22-4f33-ba17-da357b9a7740]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:01 devstack sudo[101542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931
Nov 02 10:17:01 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:02 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" returned: 0 in 0.437s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:02 devstack sudo[101550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 1G
Nov 02 10:17:02 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-96f094b0-43c8-44cf-8ec3-e61e415cb3e1-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-96f094b0-43c8-44cf-8ec3-e61e415cb3e1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" acquired by "delete_volume" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:02 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[24889878-6e0f-4eb1-b18b-650cdbe4734b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:02 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1
Nov 02 10:17:02 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:02 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 1G" returned: 0 in 0.598s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:02 devstack sudo[101558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795
Nov 02 10:17:02 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:03 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" returned: 0 in 0.509s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:03 devstack sudo[101564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1
Nov 02 10:17:03 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:03 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795" returned: 0 in 0.469s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:03 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 is being set with open permissions: ugo+rw
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:03 devstack sudo[101571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795
Nov 02 10:17:03 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:03 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" returned: 0 in 0.344s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-96f094b0-43c8-44cf-8ec3-e61e415cb3e1" released by "delete_volume" :: held 0.948s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Created reservations ['5489caee-ccf1-488c-bb0d-2eba73bac328', '9c3a5378-8db8-4a76-b952-6b6d4d2bf360', 'b5ff424c-904d-425c-a3db-a1879b878083', '103935da-6897-4780-b6bc-055a3cba6288'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Flow 'volume_create_manager' (20a5198a-eb45-4c90-bd36-4b31e97b9a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07758d07-7743-4a79-a3d2-7081dc7d7f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07758d07-7743-4a79-a3d2-7081dc7d7f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d635301-f0ea-43ce-885d-2deedae106fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2564e7da034b64a2b0f0b16dc80585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:03Z,use_quota=True,user_id='63d939326c9e41b59297f29c7f0c6a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91a00fc-a034-40e5-8040-05e1694c6543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91a00fc-a034-40e5-8040-05e1694c6543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160b4278-8d3d-47ea-b043-7a5af5424e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160b4278-8d3d-47ea-b043-7a5af5424e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d635301-f0ea-43ce-885d-2deedae106fa', 'volume_name': 'volume-2d635301-f0ea-43ce-885d-2deedae106fa', 'volume_size': 1, 'snapshot_id': '4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfa150f-98bc-4c96-9215-76c4c98ab385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfa150f-98bc-4c96-9215-76c4c98ab385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a896f1aa-cd93-447a-bfed-8b39643cd6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:03 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Volume 2d635301-f0ea-43ce-885d-2deedae106fa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d635301-f0ea-43ce-885d-2deedae106fa', 'volume_size': 1, 'snapshot_id': '4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a'}
Nov 02 10:17:03 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795" returned: 0 in 0.310s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:03 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:17:03 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:03 devstack sudo[101576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.info
Nov 02 10:17:03 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:03 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.256s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:17:03 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Deleted volume successfully.
Nov 02 10:17:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ad1e7de4-f084-4698-8707-6d97cc080eb4 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-96f094b0-43c8-44cf-8ec3-e61e415cb3e1-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:04 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.info" returned: 0 in 0.314s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:04 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.info is being set with open permissions: ugo+rw
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:04 devstack sudo[101580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.info
Nov 02 10:17:04 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:04 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.info" returned: 0 in 0.259s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.654s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "cinder-quobyte-4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a-2d635301-f0ea-43ce-885d-2deedae106fa" by "_create_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a-2d635301-f0ea-43ce-885d-2deedae106fa" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Creating volume 2d635301-f0ea-43ce-885d-2deedae106fa from snapshot 4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a {{(pid=87014) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "cinder-quobyte-2d635301-f0ea-43ce-885d-2deedae106fa" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:04 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f48fcf46-b22f-4104-a220-b350cfb16604 tempest-VolumesExtendTest-66155195 None] Create snapshot completed successfully
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-2d635301-f0ea-43ce-885d-2deedae106fa" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] snapshot: 4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a, volume: 2d635301-f0ea-43ce-885d-2deedae106fa,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81a7b1f-ff50-4b64-9c7f-a727cc10a851]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:04 devstack sudo[101583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a
Nov 02 10:17:04 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-fcbc1376-21cf-4c15-9432-9cdd3d6352c4-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-fcbc1376-21cf-4c15-9432-9cdd3d6352c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "cinder-quobyte-fcbc1376-21cf-4c15-9432-9cdd3d6352c4" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-fcbc1376-21cf-4c15-9432-9cdd3d6352c4" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[35005995-2127-492a-83a8-2a80ffc69dd9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:04 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a" returned: 0 in 0.429s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[432c8d82-939c-4a26-99a0-7315f949bc83]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:04 devstack sudo[101591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4
Nov 02 10:17:04 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bc4dfd72-6f0e-4990-9f0a-18d8ce70d183 tempest-VolumesExtendTest-66155195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:05 devstack sudo[101592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17
Nov 02 10:17:05 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:05 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" returned: 0 in 0.398s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:05 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4" returned: 0 in 0.498s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:05 devstack sudo[101601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa
Nov 02 10:17:05 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:05 devstack sudo[101602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4
Nov 02 10:17:05 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:05 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fcbc1376-21cf-4c15-9432-9cdd3d6352c4" returned: 0 in 0.392s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-quobyte-fcbc1376-21cf-4c15-9432-9cdd3d6352c4" released by "delete_volume" :: held 0.986s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Created reservations ['abbb7392-4dd2-428b-91f4-f100c78146ae', 'b43d724f-7f25-4124-b69a-de9cb1dd8305', '1d0c608c-6e76-41b1-9721-46f53c010c67', '4abadf05-c126-4b05-bce4-11b596ffe697'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:05 devstack sudo[101610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:17:05 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:06 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.604s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:06 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:17:06 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Deleted volume successfully.
Nov 02 10:17:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6e4bd6ce-a26c-4a90-86b0-68db9b748a83 tempest-VolumesSnapshotTestJSON-164813266 None] Lock "cinder-fcbc1376-21cf-4c15-9432-9cdd3d6352c4-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:07 devstack sudo[101619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:17:07 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:07 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.395s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:17:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:17:14 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa" returned: 0 in 9.022s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17, size 1024.00 MB, duration 9.02 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:17:14 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Converted 1024.00 MB image at 113.49 MB/s
Nov 02 10:17:14 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa is being set with open permissions: ugo+rw
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:14 devstack sudo[101624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa
Nov 02 10:17:14 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:14 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa" returned: 0 in 0.325s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-2d635301-f0ea-43ce-885d-2deedae106fa" released by "_copy_volume_from_snapshot" :: held 10.283s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=114,cinder:INSERT=35,cinder:UPDATE=134,cinder:DELETE=10 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a-2d635301-f0ea-43ce-885d-2deedae106fa" released by "_create_volume_from_snapshot" :: held 10.358s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.395s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bc4dfd72-6f0e-4990-9f0a-18d8ce70d183 tempest-VolumesExtendTest-66155195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 9.716s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[747f5baf-b375-483e-be38-1f8ba41912c9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bc4dfd72-6f0e-4990-9f0a-18d8ce70d183 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a896f1aa-cd93-447a-bfed-8b39643cd6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d635301-f0ea-43ce-885d-2deedae106fa', 'volume_size': 1, 'snapshot_id': '4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c8a7ee-86e8-48f4-bbf3-65045e251c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:14 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Volume volume-2d635301-f0ea-43ce-885d-2deedae106fa (2d635301-f0ea-43ce-885d-2deedae106fa): created successfully
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c8a7ee-86e8-48f4-bbf3-65045e251c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Flow 'volume_create_manager' (20a5198a-eb45-4c90-bd36-4b31e97b9a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:14 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ea4bcfb6-7977-4b8b-a267-e0b213f60ddf tempest-SnapshotDependencyTests-511954894 None] Created volume successfully.
Nov 02 10:17:14 devstack sudo[101627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931
Nov 02 10:17:14 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:15 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bc4dfd72-6f0e-4990-9f0a-18d8ce70d183 tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" returned: 0 in 0.446s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bc4dfd72-6f0e-4990-9f0a-18d8ce70d183 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 2G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bc4dfd72-6f0e-4990-9f0a-18d8ce70d183 tempest-VolumesExtendTest-66155195 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 2G" returned: 0 in 0.182s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bc4dfd72-6f0e-4990-9f0a-18d8ce70d183 tempest-VolumesExtendTest-66155195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.682s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-bc4dfd72-6f0e-4990-9f0a-18d8ce70d183 tempest-VolumesExtendTest-66155195 None] Extend volume completed successfully.
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "cinder-4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "cinder-quobyte-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "cinder-quobyte-4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Deleting offline snapshot 4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a of volume 61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] snapshot_file for this snap is: volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7884e12-9b8c-4c8f-b541-15c66068b7a2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:16 devstack sudo[101636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a
Nov 02 10:17:16 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:16 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a" returned: 0 in 0.412s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0681bc7-1868-43dc-a71e-a8312f1999d9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:16 devstack sudo[101642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17
Nov 02 10:17:16 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Acquiring lock "cinder-97ee585f-66a3-4df9-8b5f-8711dc494795-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Lock "cinder-97ee585f-66a3-4df9-8b5f-8711dc494795-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Acquiring lock "cinder-quobyte-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Lock "cinder-quobyte-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Acquiring lock "cinder-quobyte-97ee585f-66a3-4df9-8b5f-8711dc494795" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Lock "cinder-quobyte-97ee585f-66a3-4df9-8b5f-8711dc494795" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Deleting offline snapshot 97ee585f-66a3-4df9-8b5f-8711dc494795 of volume 0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] snapshot_file for this snap is: volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[521beb89-36fc-4483-aaa3-ac54305d1791]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:16 devstack sudo[101644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795
Nov 02 10:17:16 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:17 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" returned: 0 in 0.919s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:17 devstack sudo[101686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a
Nov 02 10:17:17 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:17 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795" returned: 0 in 0.658s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:17:17 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5961b056-55cf-4148-b95e-ff7c7f05c5a7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:17 devstack sudo[101688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931
Nov 02 10:17:17 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:17 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a" returned: 0 in 0.546s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:17 devstack sudo[101699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a
Nov 02 10:17:17 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:18 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" returned: 0 in 0.594s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:18 devstack sudo[101704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795
Nov 02 10:17:18 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:18 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17.4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a" returned: 0 in 0.367s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a" released by "_delete_snapshot" :: held 2.424s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" released by "delete_snapshot" :: held 2.465s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:18 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Created reservations ['c1eeea89-ef14-4691-9323-0ffcabbfa1fa', '6c5aa89e-6608-46b9-9eda-0838260eda6e', '261be98b-d0c7-456e-ac94-91ffc64b34b7', 'bda82fbb-4ed5-45a2-89a4-eef24ece2726'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:17:18 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Delete snapshot completed successfully.
Nov 02 10:17:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-72edfb13-4227-4f59-ac74-f3097322acd5 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-4be9217b-6e72-4ee9-8dc3-ffeea0d2e67a-delete_snapshot" released by "delete_snapshot" :: held 2.719s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:18 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795" returned: 0 in 0.601s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:18 devstack sudo[101712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795
Nov 02 10:17:18 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:18 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931.97ee585f-66a3-4df9-8b5f-8711dc494795" returned: 0 in 0.295s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Lock "cinder-quobyte-97ee585f-66a3-4df9-8b5f-8711dc494795" released by "_delete_snapshot" :: held 2.368s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Lock "cinder-quobyte-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" released by "delete_snapshot" :: held 2.407s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "cinder-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "cinder-quobyte-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Created reservations ['9e21c2ba-db8d-43f5-b7a5-c75d47c33d98', 'e13e0d7e-779f-422d-9666-d2614394852b', 'd58e3223-6148-455f-9621-bf7a659e45c6', '84a52fdf-5ad1-4c68-b51d-b2bae5ae5e04'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb4adba-9022-4257-92a4-4b5f9980f029]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Delete snapshot completed successfully.
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59523854-6cba-40ee-acbf-a558fbfd6d3a tempest-VolumesExtendTest-66155195 None] Lock "cinder-97ee585f-66a3-4df9-8b5f-8711dc494795-delete_snapshot" released by "delete_snapshot" :: held 2.710s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:19 devstack sudo[101715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17
Nov 02 10:17:19 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:19 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" returned: 0 in 0.470s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:19 devstack sudo[101720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17
Nov 02 10:17:19 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Acquiring lock "cinder-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Lock "cinder-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Acquiring lock "cinder-quobyte-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Lock "cinder-quobyte-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:20 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" returned: 0 in 0.413s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[de67330b-edce-4cc0-86d5-04dfb37c9429]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17" released by "delete_volume" :: held 0.996s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Created reservations ['a09d2e2e-dff6-483c-a039-18786ad4a210', '2f3a79e8-685c-4472-859b-4398b9731655', 'd87210b8-b95a-4288-91e4-ca2f9b0f8f2c', 'c239fa4d-c645-437c-8fe1-bb30fcea499d'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:17:20 devstack sudo[101723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931
Nov 02 10:17:20 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:20 devstack sudo[101725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:17:20 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:20 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" returned: 0 in 0.566s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:20 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.297s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:17:20 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Deleted volume successfully.
Nov 02 10:17:20 devstack sudo[101731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931
Nov 02 10:17:20 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d612bc9-c38e-4362-9cd8-b96670b12e10 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-61f9ffb5-cbfd-4311-bcf2-f40c7d09bf17-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:21 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" returned: 0 in 0.301s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Lock "cinder-quobyte-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931" released by "delete_volume" :: held 1.007s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Created reservations ['639ec04a-61d6-4861-ba4e-a5fb74ce8cd2', '461e102a-7628-4a26-b0b2-61f36c364d00', '23667ea0-8628-407b-9f26-73a90b62078b', '95466bb7-ba9f-41a5-9236-12b3fd0b5988'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:21 devstack sudo[101734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:17:21 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "cinder-2d635301-f0ea-43ce-885d-2deedae106fa-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-2d635301-f0ea-43ce-885d-2deedae106fa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "cinder-quobyte-2d635301-f0ea-43ce-885d-2deedae106fa" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:21 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.335s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-2d635301-f0ea-43ce-885d-2deedae106fa" acquired by "delete_volume" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:21 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Deleted volume successfully.
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1f28da-c1bf-470a-b8c6-43a6ad151de8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:21 devstack sudo[101737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa
Nov 02 10:17:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e903490-56f8-4af7-af88-56213d3bec84 tempest-VolumesExtendTest-66155195 None] Lock "cinder-0ed2ff92-588c-4c2e-91ee-f0b0b84bd931-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:21 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:22 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa" returned: 0 in 0.525s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:22 devstack sudo[101742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa
Nov 02 10:17:22 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:22 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2d635301-f0ea-43ce-885d-2deedae106fa" returned: 0 in 0.500s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-quobyte-2d635301-f0ea-43ce-885d-2deedae106fa" released by "delete_volume" :: held 1.100s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:22 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Created reservations ['856c9f63-a5b9-4487-9dfe-f01d882bc87b', '0be3e3f4-2bf4-4c85-8aa2-a8969686ae5e', 'c6299d22-f89b-4c02-aad9-4d4ac10d982d', '5c9cc8f7-4837-43d9-a880-01aac9c7c635'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:17:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:22 devstack sudo[101745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:17:22 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:23 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.361s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:23 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:17:23 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Deleted volume successfully.
Nov 02 10:17:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-07e405f5-458d-4a9e-b660-6c8e7fc992f8 tempest-SnapshotDependencyTests-511954894 None] Lock "cinder-2d635301-f0ea-43ce-885d-2deedae106fa-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (d4ee474e-2583-4920-bde7-a0a87159e5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3173ea9-d3a0-4b62-9ec7-4a7c1a95199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3173ea9-d3a0-4b62-9ec7-4a7c1a95199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1490064336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6ebb76-1e2b-4325-9d29-28248d5307dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:31Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7f32ef-e01d-43d1-8255-75e060d744dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7f32ef-e01d-43d1-8255-75e060d744dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf2bd94-d277-4840-a957-ca08a3d4ab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf2bd94-d277-4840-a957-ca08a3d4ab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b6ebb76-1e2b-4325-9d29-28248d5307dc', 'volume_name': 'volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff93b4f0-44fc-485d-a493-e9e7f668a146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff93b4f0-44fc-485d-a493-e9e7f668a146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57758fd8-144e-4808-bce8-8fdde1354843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:31 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Volume 8b6ebb76-1e2b-4325-9d29-28248d5307dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc', 'volume_size': 1}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1490064336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b6ebb76-1e2b-4325-9d29-28248d5307dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:31Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Creating volume 8b6ebb76-1e2b-4325-9d29-28248d5307dc {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:17:31 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:31 devstack sudo[101752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc 1073741824
Nov 02 10:17:31 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:31 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc 1073741824" returned: 0 in 0.552s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:31 devstack sudo[101758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc
Nov 02 10:17:31 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:32 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc" returned: 0 in 0.432s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:17:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57758fd8-144e-4808-bce8-8fdde1354843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76675be8-e7d7-4508-9769-3d6b3b6a83cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:32 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Volume volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc (8b6ebb76-1e2b-4325-9d29-28248d5307dc): created successfully
Nov 02 10:17:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76675be8-e7d7-4508-9769-3d6b3b6a83cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (d4ee474e-2583-4920-bde7-a0a87159e5ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:32 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-39ec27fc-1e1a-4427-bacc-fc9aca91bbc8 tempest-VolumesGetTest-1587441591 None] Created volume successfully.
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (de68b334-d8e3-49e7-a20c-df6e77a95689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f5a291-e5ec-430a-b356-f587092fecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f5a291-e5ec-430a-b356-f587092fecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-434623484',display_name='tempest-VolumesGetTest-Volume-446786288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb64c3f-b929-42f5-b6bb-7a58331ce481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:34Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cdfbeaf-8fe4-4efd-a2a0-726da866dbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cdfbeaf-8fe4-4efd-a2a0-726da866dbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96f7764-a6b5-4482-ad88-5a87de4bd1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96f7764-a6b5-4482-ad88-5a87de4bd1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb64c3f-b929-42f5-b6bb-7a58331ce481', 'volume_name': 'volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bea1e23-9728-47f3-9b0b-fdd52f326f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bea1e23-9728-47f3-9b0b-fdd52f326f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726e3740-289d-451d-886b-9a49a29e7a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:34 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Volume fdb64c3f-b929-42f5-b6bb-7a58331ce481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481', 'volume_size': 1}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-434623484',display_name='tempest-VolumesGetTest-Volume-446786288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb64c3f-b929-42f5-b6bb-7a58331ce481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:34Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Creating volume fdb64c3f-b929-42f5-b6bb-7a58331ce481 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:17:34 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:34 devstack sudo[101762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481 1073741824
Nov 02 10:17:34 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:34 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481 1073741824" returned: 0 in 0.532s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:35 devstack sudo[101768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481
Nov 02 10:17:35 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:35 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481" returned: 0 in 0.293s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:17:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726e3740-289d-451d-886b-9a49a29e7a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6ca3f4-b0b4-48b7-b3c0-29065bede889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:35 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Volume volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481 (fdb64c3f-b929-42f5-b6bb-7a58331ce481): created successfully
Nov 02 10:17:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6ca3f4-b0b4-48b7-b3c0-29065bede889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (de68b334-d8e3-49e7-a20c-df6e77a95689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:35 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e57f21a7-0f19-486a-abee-cfc7f4a247fe tempest-VolumesGetTest-1587441591 None] Created volume successfully.
Nov 02 10:17:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-fdb64c3f-b929-42f5-b6bb-7a58331ce481-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Lock "cinder-fdb64c3f-b929-42f5-b6bb-7a58331ce481-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-quobyte-fdb64c3f-b929-42f5-b6bb-7a58331ce481" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-fdb64c3f-b929-42f5-b6bb-7a58331ce481" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:36 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0079c25f-ead8-4fa4-bc31-3d76acd9d2ce]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:36 devstack sudo[101771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481
Nov 02 10:17:36 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:37 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481" returned: 0 in 0.499s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:37 devstack sudo[101776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481
Nov 02 10:17:37 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:37 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fdb64c3f-b929-42f5-b6bb-7a58331ce481" returned: 0 in 0.398s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-fdb64c3f-b929-42f5-b6bb-7a58331ce481" released by "delete_volume" :: held 0.984s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:37 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Created reservations ['d5454388-8961-44d2-ac3a-add2e89f9d9e', '2dbb9f2a-3bbf-476f-bf42-8a17f999d91b', '103d2842-2ca3-4688-a7b2-8efae8d84c77', 'af2caa65-73f2-48de-a30c-7fef921c2677'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:17:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:37 devstack sudo[101779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:17:37 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:38 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.298s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:38 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:17:38 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Deleted volume successfully.
Nov 02 10:17:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fcf28709-730d-4842-86e7-506bf29fd465 tempest-VolumesGetTest-1587441591 None] Lock "cinder-fdb64c3f-b929-42f5-b6bb-7a58331ce481-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-8b6ebb76-1e2b-4325-9d29-28248d5307dc-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Lock "cinder-8b6ebb76-1e2b-4325-9d29-28248d5307dc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-quobyte-8b6ebb76-1e2b-4325-9d29-28248d5307dc" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-8b6ebb76-1e2b-4325-9d29-28248d5307dc" acquired by "delete_volume" :: waited 0.046s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6314d65-183a-4751-bc04-c83e8ad16d79]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:39 devstack sudo[101783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc
Nov 02 10:17:39 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:39 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc" returned: 0 in 0.633s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:39 devstack sudo[101788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc
Nov 02 10:17:39 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Flow 'volume_create_manager' (47118955-3785-4c39-8930-e26580e2ecfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78d07ec-ff9c-4aeb-8944-dc02666ce31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78d07ec-ff9c-4aeb-8944-dc02666ce31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1484488105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7025f57b-c6e3-4986-845d-52b13d47249c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9222563b5a2e4de18bf5b3ab0d3d2843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:40Z,use_quota=True,user_id='98c6193bd6bd46dca6b7753ee196ec51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b8c657-011d-4be8-b058-f1598b94bc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b8c657-011d-4be8-b058-f1598b94bc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c798882c-3032-40bf-8aec-9e28d40aa808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:39 devstack cinder-volume[87014]: DEBUG cinder.image.glance [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Creating Keystone auth plugin from conf {{(pid=87014) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 02 10:17:40 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8b6ebb76-1e2b-4325-9d29-28248d5307dc" returned: 0 in 0.467s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-8b6ebb76-1e2b-4325-9d29-28248d5307dc" released by "delete_volume" :: held 1.200s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c798882c-3032-40bf-8aec-9e28d40aa808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7025f57b-c6e3-4986-845d-52b13d47249c', 'volume_name': 'volume-7025f57b-c6e3-4986-845d-52b13d47249c', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0c1d60>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d573849a-a18e-4345-8f71-060bc8163a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d573849a-a18e-4345-8f71-060bc8163a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22429c1-5381-4ef5-8ff8-cd6eafab682b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:40 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Volume 7025f57b-c6e3-4986-845d-52b13d47249c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7025f57b-c6e3-4986-845d-52b13d47249c', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0c1d60>}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Trying to clone 7025f57b-c6e3-4986-845d-52b13d47249c from image c35ca8ac-fc2e-4930-9230-8b67e658a8ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]). {{(pid=87014) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Created reservations ['97e8ec5a-3593-4fed-a0d7-10efeeadc819', '13a5e28b-a047-476c-bc67-8e62aa896fe2', '43bc5971-de0f-40dd-8963-6380e9392895', '78e93624-3437-4845-a4cf-7e29b508ac93'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:40 devstack sudo[101793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:17:40 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 02 10:17:40 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Image download 20.69 MB at 20.69 MB/s
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed010efd-e6a3-4af3-9d40-ee537af0962e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:40 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.428s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:17:40 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Deleted volume successfully.
Nov 02 10:17:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c13ceeb7-00a1-46a4-a2a9-ad7b14f7e4ef tempest-VolumesGetTest-1587441591 None] Lock "cinder-8b6ebb76-1e2b-4325-9d29-28248d5307dc-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:41 devstack sudo[101797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD
Nov 02 10:17:41 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:41 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:41 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Temporary image c35ca8ac-fc2e-4930-9230-8b67e658a8ae is fetched for user 98c6193bd6bd46dca6b7753ee196ec51. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 02 10:17:41 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[111dc494-a594-4fbd-b861-8e88c664fe81]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:41 devstack sudo[101802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD
Nov 02 10:17:41 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:17:42 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (3dce197c-edf3-4721-b753-c90230e8a3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac7630c-3b53-4bc9-862e-4f7a462140a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD" returned: 0 in 0.660s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1484488105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7025f57b-c6e3-4986-845d-52b13d47249c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9222563b5a2e4de18bf5b3ab0d3d2843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:40Z,use_quota=True,user_id='98c6193bd6bd46dca6b7753ee196ec51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Creating volume 7025f57b-c6e3-4986-845d-52b13d47249c {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:17:42 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac7630c-3b53-4bc9-862e-4f7a462140a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1017414524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2945faf6-85bd-40d3-aede-c3f7a3830843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:42Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef439b0-b2ab-438a-b0d3-22c65dbe5250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:42 devstack sudo[101807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c 1073741824
Nov 02 10:17:42 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef439b0-b2ab-438a-b0d3-22c65dbe5250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfeea06-10b3-4946-a09b-a8d3a7bee2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfeea06-10b3-4946-a09b-a8d3a7bee2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2945faf6-85bd-40d3-aede-c3f7a3830843', 'volume_name': 'volume-2945faf6-85bd-40d3-aede-c3f7a3830843', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4755eb-c752-44f1-bbf5-727a3e3e3cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4755eb-c752-44f1-bbf5-727a3e3e3cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d13f686-b04b-405a-bf89-f19f7028e2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:42 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Volume 2945faf6-85bd-40d3-aede-c3f7a3830843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2945faf6-85bd-40d3-aede-c3f7a3830843', 'volume_size': 1}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:42 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c 1073741824" returned: 0 in 0.532s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:42 devstack sudo[101813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c
Nov 02 10:17:42 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:43 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c" returned: 0 in 0.330s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1017414524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2945faf6-85bd-40d3-aede-c3f7a3830843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:42Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Creating volume 2945faf6-85bd-40d3-aede-c3f7a3830843 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:17:43 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:43 devstack sudo[101816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 1073741824
Nov 02 10:17:43 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Attempting download of c35ca8ac-fc2e-4930-9230-8b67e658a8ae ((None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}])) to volume 7025f57b-c6e3-4986-845d-52b13d47249c. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6898b9c-07ae-4fcd-8dad-53a4b5771ee5]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_vnn0lfu5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:43 devstack sudo[101818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_vnn0lfu5
Nov 02 10:17:43 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:43 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 1073741824" returned: 0 in 0.644s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:43 devstack sudo[101824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843
Nov 02 10:17:43 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:43 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_vnn0lfu5" returned: 0 in 0.489s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_vnn0lfu5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:44 devstack sudo[101828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_vnn0lfu5
Nov 02 10:17:44 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:44 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843" returned: 0 in 0.535s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d13f686-b04b-405a-bf89-f19f7028e2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2945faf6-85bd-40d3-aede-c3f7a3830843', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139f57ec-b2e0-4f26-9ced-174abc97c4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:44 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Volume volume-2945faf6-85bd-40d3-aede-c3f7a3830843 (2945faf6-85bd-40d3-aede-c3f7a3830843): created successfully
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139f57ec-b2e0-4f26-9ced-174abc97c4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (3dce197c-edf3-4721-b753-c90230e8a3c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-896bcddb-5a4a-4909-b3ad-aee7819bd1a3 tempest-VolumesGetTest-1587441591 None] Created volume successfully.
Nov 02 10:17:44 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_vnn0lfu5" returned: 1 in 0.635s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_vnn0lfu5' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[13af1893-e951-4ae4-9815-a4b412d37bce]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:44 devstack sudo[101834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD
Nov 02 10:17:44 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:44 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] c35ca8ac-fc2e-4930-9230-8b67e658a8ae was qcow2, converting to qcow2 {{(pid=87014) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 02 10:17:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:44 devstack sudo[101839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c
Nov 02 10:17:44 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=92,cinder:UPDATE=126,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (6b45216f-db79-4eea-97ad-6d39823fa130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ae8c64-8a19-429a-bc89-914fe7f30a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ae8c64-8a19-429a-bc89-914fe7f30a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-417318325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7883e3-64dd-48e4-aaaa-9d9fa400a28d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=2945faf6-85bd-40d3-aede-c3f7a3830843,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:46Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a316f8a4-aae5-474f-a8db-c372ca76dfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a316f8a4-aae5-474f-a8db-c372ca76dfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f2366a-e9ad-4af9-bb23-c984a1a4913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f2366a-e9ad-4af9-bb23-c984a1a4913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cf7883e3-64dd-48e4-aaaa-9d9fa400a28d', 'volume_name': 'volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d', 'volume_size': 1, 'source_volid': '2945faf6-85bd-40d3-aede-c3f7a3830843', 'source_volstatus': 'available'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c6acf9-395b-426f-9104-4d2116a24ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c6acf9-395b-426f-9104-4d2116a24ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d621ff00-3f6a-43df-9af8-33847cdfe290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Volume cf7883e3-64dd-48e4-aaaa-9d9fa400a28d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d', 'volume_size': 1, 'source_volid': '2945faf6-85bd-40d3-aede-c3f7a3830843', 'source_volstatus': 'available'}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:46 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Cloning volume 2945faf6-85bd-40d3-aede-c3f7a3830843 to volume cf7883e3-64dd-48e4-aaaa-9d9fa400a28d
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Creating offline snapshot ea1f1f90-7af7-4760-9e91-888085247c02 of volume 2945faf6-85bd-40d3-aede-c3f7a3830843 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b124fd-99c1-43d1-a3a1-9a68f861507e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:46 devstack sudo[101851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843
Nov 02 10:17:46 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:46 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843" returned: 0 in 0.551s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:46 devstack sudo[101856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02 1G
Nov 02 10:17:46 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:47 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02 1G" returned: 0 in 0.733s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2945faf6-85bd-40d3-aede-c3f7a3830843 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:47 devstack sudo[101862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2945faf6-85bd-40d3-aede-c3f7a3830843 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02
Nov 02 10:17:47 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:47 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c" returned: 0 in 2.827s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:47 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_n4771ckydevstack@QuobyteHD, size 112.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:17:47 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Converted 112.00 MB image at 39.56 MB/s
Nov 02 10:17:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:47 devstack sudo[101864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c 1G
Nov 02 10:17:47 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:48 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2945faf6-85bd-40d3-aede-c3f7a3830843 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02" returned: 0 in 0.367s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:48 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02 is being set with open permissions: ugo+rw
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:48 devstack sudo[101873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02
Nov 02 10:17:48 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:48 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c 1G" returned: 0 in 0.436s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Downloaded image c35ca8ac-fc2e-4930-9230-8b67e658a8ae ((None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}])) to volume 7025f57b-c6e3-4986-845d-52b13d47249c successfully. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Temporary image c35ca8ac-fc2e-4930-9230-8b67e658a8ae for user 98c6193bd6bd46dca6b7753ee196ec51 is deleted. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Marking volume 7025f57b-c6e3-4986-845d-52b13d47249c as bootable. {{(pid=87014) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Copying metadata from image c35ca8ac-fc2e-4930-9230-8b67e658a8ae to 7025f57b-c6e3-4986-845d-52b13d47249c. {{(pid=87014) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Creating volume glance metadata for volume 7025f57b-c6e3-4986-845d-52b13d47249c backed by image c35ca8ac-fc2e-4930-9230-8b67e658a8ae with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87014) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22429c1-5381-4ef5-8ff8-cd6eafab682b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7025f57b-c6e3-4986-845d-52b13d47249c', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0c1d60>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1213389d-d7e9-4372-be78-dd407e18458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:48 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Volume volume-7025f57b-c6e3-4986-845d-52b13d47249c (7025f57b-c6e3-4986-845d-52b13d47249c): created successfully
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1213389d-d7e9-4372-be78-dd407e18458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:48 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Flow 'volume_create_manager' (47118955-3785-4c39-8930-e26580e2ecfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02" returned: 0 in 0.370s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fce9cc10-50cc-4b20-9a4a-c06af426154b tempest-TestShelveInstance-2143570346 None] Created volume successfully.
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:48 devstack sudo[101877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.info
Nov 02 10:17:48 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:48 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.info" returned: 0 in 0.250s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:48 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.info is being set with open permissions: ugo+rw
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:48 devstack sudo[101881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.info
Nov 02 10:17:48 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:48 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.info" returned: 0 in 0.251s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-quobyte-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] snapshot: ea1f1f90-7af7-4760-9e91-888085247c02, volume: cf7883e3-64dd-48e4-aaaa-9d9fa400a28d,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4d875b-c4e2-44d7-95b8-58ab911b19fb]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:49 devstack sudo[101884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02
Nov 02 10:17:49 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:49 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02" returned: 0 in 0.374s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2945faf6-85bd-40d3-aede-c3f7a3830843(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[920d2c18-acd3-465c-916b-510318152dac]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:49 devstack sudo[101889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843
Nov 02 10:17:49 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:49 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843" returned: 0 in 0.465s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:17:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:49 devstack sudo[101894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d
Nov 02 10:17:49 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Flow 'volume_create_manager' (b0e44893-7e9a-4985-9269-2283b9902cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb41cfc-092b-4ebd-b437-7e67d98e4c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb41cfc-092b-4ebd-b437-7e67d98e4c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-376893911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c451b5441247b0846de4fd35e7632b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:52Z,use_quota=True,user_id='582703c4d4e04f92afa7baa53d964947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ade148-f270-4630-9abd-54b61f4718d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ade148-f270-4630-9abd-54b61f4718d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc41fe1-77a6-4f90-9aee-ff2b68249be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc41fe1-77a6-4f90-9aee-ff2b68249be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6', 'volume_name': 'volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd20f9f-879b-4f0a-ad3e-4484e62e9450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd20f9f-879b-4f0a-ad3e-4484e62e9450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153ed133-9a03-41fd-9e6e-13cd203b8437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:17:52 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Volume 93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6', 'volume_size': 1}
Nov 02 10:17:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-1b8d5ab1-d6f2-491a-aef9-1f624814ae28 req-3a392fb0-c47c-46d7-8273-c150d4c8055d tempest-TestShelveInstance-2143570346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:17:58 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d" returned: 0 in 8.162s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:17:58 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Converted 1024.00 MB image at 125.45 MB/s
Nov 02 10:17:58 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d is being set with open permissions: ugo+rw
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:58 devstack sudo[101924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d
Nov 02 10:17:58 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:58 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d" returned: 0 in 0.268s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d" released by "_copy_volume_from_snapshot" :: held 9.367s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-quobyte-ea1f1f90-7af7-4760-9e91-888085247c02" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-ea1f1f90-7af7-4760-9e91-888085247c02" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Deleting offline snapshot ea1f1f90-7af7-4760-9e91-888085247c02 of volume 2945faf6-85bd-40d3-aede-c3f7a3830843 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] snapshot_file for this snap is: volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7e1476-b3cf-4072-8720-429f0c0c276a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:58 devstack sudo[101927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02
Nov 02 10:17:58 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:58 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02" returned: 0 in 0.438s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2945faf6-85bd-40d3-aede-c3f7a3830843(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dc006e-3215-487f-87eb-2558188ed208]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:17:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:59 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843
Nov 02 10:17:59 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:59 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843" returned: 0 in 0.677s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:17:59 devstack sudo[101939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02
Nov 02 10:17:59 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:17:59 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root
Nov 02 10:17:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02" returned: 0 in 0.399s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:17:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:00 devstack sudo[101945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02
Nov 02 10:18:00 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:00 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843.ea1f1f90-7af7-4760-9e91-888085247c02" returned: 0 in 0.316s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-ea1f1f90-7af7-4760-9e91-888085247c02" released by "_delete_snapshot" :: held 1.963s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.096s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-376893911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c451b5441247b0846de4fd35e7632b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:17:52Z,use_quota=True,user_id='582703c4d4e04f92afa7baa53d964947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Creating volume 93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:18:00 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:00 devstack sudo[101948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 1073741824
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d621ff00-3f6a-43df-9af8-33847cdfe290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d', 'volume_size': 1, 'source_volid': '2945faf6-85bd-40d3-aede-c3f7a3830843', 'source_volstatus': 'available'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:00 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee85302-f25e-408d-aad9-694e42efeaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:00 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Volume volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d (cf7883e3-64dd-48e4-aaaa-9d9fa400a28d): created successfully
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee85302-f25e-408d-aad9-694e42efeaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (6b45216f-db79-4eea-97ad-6d39823fa130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:00 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4f9d88f6-250a-4850-bbb9-07ae665cd709 tempest-VolumesGetTest-1587441591 None] Created volume successfully.
Nov 02 10:18:00 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 1073741824" returned: 0 in 0.498s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:00 devstack sudo[101954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6
Nov 02 10:18:00 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:01 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6" returned: 0 in 0.296s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:18:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-1b8d5ab1-d6f2-491a-aef9-1f624814ae28 req-3a392fb0-c47c-46d7-8273-c150d4c8055d tempest-TestShelveInstance-2143570346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.794s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153ed133-9a03-41fd-9e6e-13cd203b8437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a9855f-0785-4f73-919b-d449c3db2208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-1b8d5ab1-d6f2-491a-aef9-1f624814ae28 req-3a392fb0-c47c-46d7-8273-c150d4c8055d tempest-TestShelveInstance-2143570346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:01 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Volume volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 (93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6): created successfully
Nov 02 10:18:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a9855f-0785-4f73-919b-d449c3db2208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Flow 'volume_create_manager' (b0e44893-7e9a-4985-9269-2283b9902cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4e094332-1fd3-4208-bd25-86ac5c916212 tempest-TestImageHashVerification-1306019567 None] Created volume successfully.
Nov 02 10:18:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-1b8d5ab1-d6f2-491a-aef9-1f624814ae28 req-3a392fb0-c47c-46d7-8273-c150d4c8055d tempest-TestShelveInstance-2143570346 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-7025f57b-c6e3-4986-845d-52b13d47249c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83ce5fd4-9a47-4718-8903-c6aae7ccebc5', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:18:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-1b8d5ab1-d6f2-491a-aef9-1f624814ae28 req-3a392fb0-c47c-46d7-8273-c150d4c8055d tempest-TestShelveInstance-2143570346 None] attachment_update completed successfully.
Nov 02 10:18:02 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:18:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (10d44281-a3a4-4e48-a0e3-9b6f9e8a22c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6db81a1-45a6-4738-aa1e-8b69a0b2b963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6db81a1-45a6-4738-aa1e-8b69a0b2b963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1492993525',display_name='tempest-VolumesGetTest-Volume-1164300008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54d9cc2-1965-48d6-ad3b-b5100eb57f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:03Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9059edc7-76c8-46cc-8af8-15a0b8e7bb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9059edc7-76c8-46cc-8af8-15a0b8e7bb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58182849-bad1-4488-b1be-d7c85503dde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58182849-bad1-4488-b1be-d7c85503dde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54d9cc2-1965-48d6-ad3b-b5100eb57f08', 'volume_name': 'volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a87f04-6204-427a-b568-061a97f91cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a87f04-6204-427a-b568-061a97f91cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b414844-a567-48c2-bb0a-53e1d82100c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:03 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Volume c54d9cc2-1965-48d6-ad3b-b5100eb57f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08', 'volume_size': 1}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1492993525',display_name='tempest-VolumesGetTest-Volume-1164300008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54d9cc2-1965-48d6-ad3b-b5100eb57f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:03Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Creating volume c54d9cc2-1965-48d6-ad3b-b5100eb57f08 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:18:03 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:03 devstack sudo[102414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08 1073741824
Nov 02 10:18:03 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:03 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08 1073741824" returned: 0 in 0.826s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:03 devstack sudo[102441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08
Nov 02 10:18:03 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:04 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08" returned: 0 in 0.262s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.370s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b414844-a567-48c2-bb0a-53e1d82100c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc51bd7e-783b-46f0-8e99-e3dc04c1ef28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8cddd6-82d3-4911-a572-6c9d00b860a9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:04 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Volume volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08 (c54d9cc2-1965-48d6-ad3b-b5100eb57f08): created successfully
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc51bd7e-783b-46f0-8e99-e3dc04c1ef28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (10d44281-a3a4-4e48-a0e3-9b6f9e8a22c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:04 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-84e23c41-63c7-41e5-b2e0-1016a4f495c3 tempest-VolumesGetTest-1587441591 None] Created volume successfully.
Nov 02 10:18:04 devstack sudo[102444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6
Nov 02 10:18:04 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:04 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6" returned: 0 in 0.530s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6209844e-98af-43ae-8dec-ad290be478c7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:05 devstack sudo[102453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6
Nov 02 10:18:05 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-c54d9cc2-1965-48d6-ad3b-b5100eb57f08-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Lock "cinder-c54d9cc2-1965-48d6-ad3b-b5100eb57f08-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-quobyte-c54d9cc2-1965-48d6-ad3b-b5100eb57f08" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-c54d9cc2-1965-48d6-ad3b-b5100eb57f08" acquired by "delete_volume" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7a0fd5-dbf1-4b26-8be5-1f79379165ab]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:05 devstack sudo[102455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08
Nov 02 10:18:05 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:05 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6" returned: 0 in 0.626s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 /opt/stack/data/cinder/conversion/93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6.temp_image.ae96a615-9b52-4c5d-9d43-f6b55fbca61901hs2rm_.img {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:05 devstack sudo[102460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 /opt/stack/data/cinder/conversion/93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6.temp_image.ae96a615-9b52-4c5d-9d43-f6b55fbca61901hs2rm_.img
Nov 02 10:18:05 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:05 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08" returned: 0 in 0.445s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:05 devstack sudo[102465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08
Nov 02 10:18:05 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:06 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c54d9cc2-1965-48d6-ad3b-b5100eb57f08" returned: 0 in 0.424s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-c54d9cc2-1965-48d6-ad3b-b5100eb57f08" released by "delete_volume" :: held 0.938s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:06 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Created reservations ['d9a5c85e-e981-47c2-916c-fa7aca2b3af9', '8dc4925f-16a1-425a-ac04-2545d01b93de', '570e2ac5-c687-495a-95ea-bae3e9abd0be', '9cdd266b-87d8-4199-90b3-435af4df59aa'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:18:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:06 devstack sudo[102478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:18:06 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:18:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:07 devstack sudo[102480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:18:07 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:07 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.905s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:18:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Deleted volume successfully.
Nov 02 10:18:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d5cbd00-06f9-42d4-bdf0-00bc69792387 tempest-VolumesGetTest-1587441591 None] Lock "cinder-c54d9cc2-1965-48d6-ad3b-b5100eb57f08-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Lock "cinder-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-quobyte-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d" acquired by "delete_volume" :: waited 0.048s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:08 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:08 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62239ec-bc51-4a57-8040-95a0ad3f5bf1]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 1.112s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:08 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:18:08 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:18:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:18:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:18:08 devstack sudo[102484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d
Nov 02 10:18:08 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:09 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d" returned: 0 in 1.043s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:09 devstack sudo[102491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d
Nov 02 10:18:09 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:09 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d" returned: 0 in 0.484s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d" released by "delete_volume" :: held 1.710s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:10 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Created reservations ['379234e9-03ab-472c-a191-4f89a85867f6', 'e64442c9-9522-4162-9d3a-21261495c503', '631a39b2-9e48-485e-a7fc-c7189b9e64e7', 'b575c371-5180-46f8-a6bb-e783d674d0be'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:18:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:10 devstack sudo[102494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:18:10 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-2945faf6-85bd-40d3-aede-c3f7a3830843-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Lock "cinder-2945faf6-85bd-40d3-aede-c3f7a3830843-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-quobyte-2945faf6-85bd-40d3-aede-c3f7a3830843" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-2945faf6-85bd-40d3-aede-c3f7a3830843" acquired by "delete_volume" :: waited 0.064s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:11 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a71bae9-8a3c-43ea-81b8-d43096670dae]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:11 devstack sudo[102497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843
Nov 02 10:18:11 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 1.026s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:11 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:18:11 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:11 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Deleted volume successfully.
Nov 02 10:18:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d543a1f-8f48-4f2e-ad11-5c1727f71435 tempest-VolumesGetTest-1587441591 None] Lock "cinder-cf7883e3-64dd-48e4-aaaa-9d9fa400a28d-delete_volume" released by "delete_volume" :: held 3.617s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:12 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843" returned: 0 in 1.199s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:12 devstack sudo[102502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843
Nov 02 10:18:12 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:13 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2945faf6-85bd-40d3-aede-c3f7a3830843" returned: 0 in 0.588s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-2945faf6-85bd-40d3-aede-c3f7a3830843" released by "delete_volume" :: held 1.995s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:13 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Created reservations ['47ed2e47-32c5-4fa6-a0e2-fd8eeccef6e1', '1a9c6d4c-f8b2-4a3c-8910-8255ea6071e0', '938a6a46-8373-4756-97a9-2a99ccc521ff', '440e990e-acb1-4c01-b89e-ab436d8e420e'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:18:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:13 devstack sudo[102505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:18:13 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:14 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.786s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:14 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:18:14 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Deleted volume successfully.
Nov 02 10:18:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2ce5857-2dac-4590-8bbc-c71e2a9f25c7 tempest-VolumesGetTest-1587441591 None] Lock "cinder-2945faf6-85bd-40d3-aede-c3f7a3830843-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:15 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 /opt/stack/data/cinder/conversion/93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6.temp_image.ae96a615-9b52-4c5d-9d43-f6b55fbca61901hs2rm_.img" returned: 0 in 10.414s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:15 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec83cfcc-8df0-4aeb-864e-ea3b30703d78]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:16 devstack sudo[102512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6
Nov 02 10:18:16 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (9ea955fb-59a2-41bd-8740-f5e30e891799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0d386d-dda2-419b-9f0a-011b0d420d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0d386d-dda2-419b-9f0a-011b0d420d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1461540926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3206b2-9c86-4ddd-8c20-106cf2d1923f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:16Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a4730a-04ed-461e-a46f-c38c89796ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a4730a-04ed-461e-a46f-c38c89796ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff67a769-ca8a-4eb2-9380-2f981ded3894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.image.glance [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Creating Keystone auth plugin from conf {{(pid=87014) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 02 10:18:16 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff67a769-ca8a-4eb2-9380-2f981ded3894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b3206b2-9c86-4ddd-8c20-106cf2d1923f', 'volume_name': 'volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0c2810>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fb0c85-adcb-45ba-b56a-98f6252fecc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fb0c85-adcb-45ba-b56a-98f6252fecc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd67e2c-4782-425f-95e6-12b8ad1468d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:16 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Volume 9b3206b2-9c86-4ddd-8c20-106cf2d1923f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0c2810>}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Trying to clone 9b3206b2-9c86-4ddd-8c20-106cf2d1923f from image c35ca8ac-fc2e-4930-9230-8b67e658a8ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]). {{(pid=87014) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6" returned: 0 in 0.762s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6, size 1024.00 MB, duration 10.41 sec, destination /opt/stack/data/cinder/conversion/93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6.temp_image.ae96a615-9b52-4c5d-9d43-f6b55fbca61901hs2rm_.img {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:18:16 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] Converted 1024.00 MB image at 98.33 MB/s
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:UPDATE=99,cinder:DELETE=8,cinder:SELECT=91,cinder:INSERT=28 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:18:16 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] ae96a615-9b52-4c5d-9d43-f6b55fbca619 was raw, no need to convert to raw {{(pid=87014) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 02 10:18:17 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 02 10:18:17 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Image download 20.69 MB at 20.69 MB/s
Nov 02 10:18:17 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adbb18e-6d9f-4e16-8da3-9381bbb1fae8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:17 devstack sudo[102518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD
Nov 02 10:18:17 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:17 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:17 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Temporary image c35ca8ac-fc2e-4930-9230-8b67e658a8ae is fetched for user 2b3d8728234249438527e4b434bd7f0d. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 02 10:18:17 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[12083d8b-df3e-4b11-8e82-cec45168ddd2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:17 devstack sudo[102523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD
Nov 02 10:18:17 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:18 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:27 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=38,cinder:INSERT=16,cinder:UPDATE=41,cinder:DELETE=5 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:18:27 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=1,cinder:INSERT=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:18:37 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-5b664c5c-57da-44e0-8cdf-9094f42e5069 req-dbb815ee-0760-44fa-8011-93c71ed526a6 tempest-TestShelveInstance-2143570346 None] Terminate volume connection completed successfully.
Nov 02 10:18:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-5b664c5c-57da-44e0-8cdf-9094f42e5069 req-dbb815ee-0760-44fa-8011-93c71ed526a6 tempest-TestShelveInstance-2143570346 None] Deleting attachment 83ce5fd4-9a47-4718-8903-c6aae7ccebc5. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.443s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] Uploaded volume to glance image-id: ae96a615-9b52-4c5d-9d43-f6b55fbca619. {{(pid=87014) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.508s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1461540926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3206b2-9c86-4ddd-8c20-106cf2d1923f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:16Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Creating volume 9b3206b2-9c86-4ddd-8c20-106cf2d1923f {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:18:38 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:18:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:38 devstack sudo[102643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f 1073741824
Nov 02 10:18:38 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:38 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b7cc3eb8-cbac-408d-8af7-e30e5a6a4c18 tempest-TestImageHashVerification-1306019567 None] Copy volume to image completed successfully.
Nov 02 10:18:39 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f 1073741824" returned: 0 in 0.484s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:39 devstack sudo[102649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f
Nov 02 10:18:39 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:39 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f" returned: 0 in 0.291s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Attempting download of c35ca8ac-fc2e-4930-9230-8b67e658a8ae ((None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}])) to volume 9b3206b2-9c86-4ddd-8c20-106cf2d1923f. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b31ac9-1c3f-49dc-84e5-32d8b0b9f45b]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_cannbns5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Acquiring lock "cinder-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Lock "cinder-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:39 devstack sudo[102652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_cannbns5
Nov 02 10:18:39 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Acquiring lock "cinder-quobyte-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Lock "cinder-quobyte-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6" acquired by "delete_volume" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b35c5a0-3ddc-4f5e-bab4-f6cbcc2bf535]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:39 devstack sudo[102656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6
Nov 02 10:18:39 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:40 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_cannbns5" returned: 0 in 0.477s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_cannbns5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:40 devstack sudo[102662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_cannbns5
Nov 02 10:18:40 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:40 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6" returned: 0 in 0.487s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:40 devstack sudo[102667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6
Nov 02 10:18:40 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:40 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_cannbns5" returned: 1 in 0.376s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_cannbns5' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[675bfd09-793a-489a-b335-5cf6af8491d6]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:40 devstack sudo[102671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD
Nov 02 10:18:40 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:40 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6" returned: 0 in 0.315s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Lock "cinder-quobyte-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6" released by "delete_volume" :: held 0.873s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Created reservations ['26c92b23-59a6-453e-93f2-a777cee207da', '768cbe62-4ebb-4a5b-a8ed-7aa8871857bf', '93739c34-5b24-4006-a611-cd4288aef637', 'c4e73806-bf61-49f0-8e6f-b6bb146ad2eb'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:40 devstack sudo[102674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:18:40 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:40 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD" returned: 0 in 0.530s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] c35ca8ac-fc2e-4930-9230-8b67e658a8ae was qcow2, converting to qcow2 {{(pid=87014) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 02 10:18:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:41 devstack sudo[102686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f
Nov 02 10:18:41 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-f4cfbbb5-3e67-4712-a7e4-403f4ae03de2 req-32b192b4-e2ca-430d-bbd2-f907ee647e26 tempest-TestShelveInstance-2143570346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-f4cfbbb5-3e67-4712-a7e4-403f4ae03de2 req-32b192b4-e2ca-430d-bbd2-f907ee647e26 tempest-TestShelveInstance-2143570346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-f4cfbbb5-3e67-4712-a7e4-403f4ae03de2 req-32b192b4-e2ca-430d-bbd2-f907ee647e26 tempest-TestShelveInstance-2143570346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:41 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.454s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:41 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:18:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Deleted volume successfully.
Nov 02 10:18:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-f4cfbbb5-3e67-4712-a7e4-403f4ae03de2 req-32b192b4-e2ca-430d-bbd2-f907ee647e26 tempest-TestShelveInstance-2143570346 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-7025f57b-c6e3-4986-845d-52b13d47249c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cab49be1-fe63-43b9-ba5d-3d22a5462aee', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:18:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-21034417-40cb-4bad-9d0e-51a30a30414d tempest-TestImageHashVerification-1306019567 None] Lock "cinder-93cbf1a9-f39c-4fcf-a4f0-3e25ac3896c6-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-f4cfbbb5-3e67-4712-a7e4-403f4ae03de2 req-32b192b4-e2ca-430d-bbd2-f907ee647e26 tempest-TestShelveInstance-2143570346 None] attachment_update completed successfully.
Nov 02 10:18:43 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f" returned: 0 in 2.587s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:43 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c35ca8ac-fc2e-4930-9230-8b67e658a8ae_kzvczs_4devstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:18:43 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Converted 112.00 MB image at 43.27 MB/s
Nov 02 10:18:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:43 devstack sudo[102700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f 1G
Nov 02 10:18:43 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:44 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f 1G" returned: 0 in 0.491s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:44 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Downloaded image c35ca8ac-fc2e-4930-9230-8b67e658a8ae ((None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}])) to volume 9b3206b2-9c86-4ddd-8c20-106cf2d1923f successfully. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 02 10:18:44 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Temporary image c35ca8ac-fc2e-4930-9230-8b67e658a8ae for user 2b3d8728234249438527e4b434bd7f0d is deleted. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 02 10:18:44 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Marking volume 9b3206b2-9c86-4ddd-8c20-106cf2d1923f as bootable. {{(pid=87014) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 02 10:18:44 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Copying metadata from image c35ca8ac-fc2e-4930-9230-8b67e658a8ae to 9b3206b2-9c86-4ddd-8c20-106cf2d1923f. {{(pid=87014) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 02 10:18:44 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Creating volume glance metadata for volume 9b3206b2-9c86-4ddd-8c20-106cf2d1923f backed by image c35ca8ac-fc2e-4930-9230-8b67e658a8ae with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87014) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 02 10:18:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd67e2c-4782-425f-95e6-12b8ad1468d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f', 'volume_size': 1, 'image_id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51f4bb882c1946c4ba2ede214daf6ae6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c35ca8ac-fc2e-4930-9230-8b67e658a8ae', 'created_at': datetime.datetime(2026, 11, 2, 8, 55, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 55, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c35ca8ac-fc2e-4930-9230-8b67e658a8ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0c2810>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954a9e04-4f3f-45e5-913b-cb244272be68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:44 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Volume volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f (9b3206b2-9c86-4ddd-8c20-106cf2d1923f): created successfully
Nov 02 10:18:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954a9e04-4f3f-45e5-913b-cb244272be68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (9ea955fb-59a2-41bd-8740-f5e30e891799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-75ea3714-5fe8-4d1e-884b-22b07f36092b tempest-VolumesGetTest-1587441591 None] Created volume successfully.
Nov 02 10:18:45 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:18:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (d261fc74-7e8d-495f-b9e2-40a7ed00cf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4b60eb-e0a3-4efe-af80-4a9bccd48d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4b60eb-e0a3-4efe-af80-4a9bccd48d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-90037233',display_name='tempest-VolumesGetTest-Volume-1634836470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1df227-2496-4c4b-8c2d-62984ed04c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:46Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d9ac62-7a74-4867-b296-62ef4a8d56b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d9ac62-7a74-4867-b296-62ef4a8d56b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5363a3-011a-4312-8833-59f875e565e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5363a3-011a-4312-8833-59f875e565e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b1df227-2496-4c4b-8c2d-62984ed04c30', 'volume_name': 'volume-2b1df227-2496-4c4b-8c2d-62984ed04c30', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0eb71b-a9f7-44e9-8a27-d96f581ce043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0eb71b-a9f7-44e9-8a27-d96f581ce043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15006ee4-63f2-4ece-82d5-2be34c74d5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Volume 2b1df227-2496-4c4b-8c2d-62984ed04c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b1df227-2496-4c4b-8c2d-62984ed04c30', 'volume_size': 1}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-90037233',display_name='tempest-VolumesGetTest-Volume-1634836470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1df227-2496-4c4b-8c2d-62984ed04c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c014446fe7f04784bac0f054dceeb78e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:46Z,use_quota=True,user_id='2b3d8728234249438527e4b434bd7f0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Creating volume 2b1df227-2496-4c4b-8c2d-62984ed04c30 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:18:46 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:46 devstack sudo[103177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30 1073741824
Nov 02 10:18:46 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:46 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30 1073741824" returned: 0 in 0.733s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:46 devstack sudo[103191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30
Nov 02 10:18:46 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:47 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30" returned: 0 in 0.297s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:18:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15006ee4-63f2-4ece-82d5-2be34c74d5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b1df227-2496-4c4b-8c2d-62984ed04c30', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd815c04-a69d-4bc6-b3e5-d5a84b0e802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:47 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Volume volume-2b1df227-2496-4c4b-8c2d-62984ed04c30 (2b1df227-2496-4c4b-8c2d-62984ed04c30): created successfully
Nov 02 10:18:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd815c04-a69d-4bc6-b3e5-d5a84b0e802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Flow 'volume_create_manager' (d261fc74-7e8d-495f-b9e2-40a7ed00cf6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c9cb1032-0683-4dd2-930c-56637dc38bfa tempest-VolumesGetTest-1587441591 None] Created volume successfully.
Nov 02 10:18:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-2b1df227-2496-4c4b-8c2d-62984ed04c30-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Lock "cinder-2b1df227-2496-4c4b-8c2d-62984ed04c30-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-quobyte-2b1df227-2496-4c4b-8c2d-62984ed04c30" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-2b1df227-2496-4c4b-8c2d-62984ed04c30" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:48 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf53f676-1dca-43e9-8c9c-b51523de1685]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:48 devstack sudo[103197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30
Nov 02 10:18:48 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:48 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30" returned: 0 in 0.490s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:48 devstack sudo[103203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30
Nov 02 10:18:48 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:48 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b1df227-2496-4c4b-8c2d-62984ed04c30" returned: 0 in 0.275s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-2b1df227-2496-4c4b-8c2d-62984ed04c30" released by "delete_volume" :: held 0.824s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:48 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Created reservations ['aa798b22-3fd2-4b6e-8010-fa8c1a2b5690', 'dbadea2b-78a9-4c23-9c01-a1c985c16bf5', '10615665-bdfc-4e68-ade3-b218183a4bbb', 'd8c61ece-7d73-449f-9a16-fb15f19cd303'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:49 devstack sudo[103207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:18:49 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-9b3206b2-9c86-4ddd-8c20-106cf2d1923f-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Lock "cinder-9b3206b2-9c86-4ddd-8c20-106cf2d1923f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Acquiring lock "cinder-quobyte-9b3206b2-9c86-4ddd-8c20-106cf2d1923f" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:18:49 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.434s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:18:49 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Deleted volume successfully.
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-9b3206b2-9c86-4ddd-8c20-106cf2d1923f" acquired by "delete_volume" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-40e69f25-3310-4620-8b77-4acabc0c3ba9 tempest-VolumesGetTest-1587441591 None] Lock "cinder-2b1df227-2496-4c4b-8c2d-62984ed04c30-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3372586f-520e-4631-a202-7cd081af5fcd]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:49 devstack sudo[103211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f
Nov 02 10:18:49 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:49 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f" returned: 0 in 0.421s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:49 devstack sudo[103216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f
Nov 02 10:18:49 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:50 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9b3206b2-9c86-4ddd-8c20-106cf2d1923f" returned: 0 in 0.304s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Lock "cinder-quobyte-9b3206b2-9c86-4ddd-8c20-106cf2d1923f" released by "delete_volume" :: held 0.788s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:50 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Created reservations ['0c2780d1-538e-4373-b071-57f489fd5fea', 'ae1bd598-1133-45d9-b07c-56afcd41bcae', '918a7551-ac9d-4f1e-977b-70759a13fcca', 'caa5165f-c898-47b6-920e-e90fa5364d67'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:18:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:50 devstack sudo[103219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:18:50 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:50 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.505s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:50 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:18:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Deleted volume successfully.
Nov 02 10:18:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-73c466b8-1ffe-4def-a6f1-d727806c34eb tempest-VolumesGetTest-1587441591 None] Lock "cinder-9b3206b2-9c86-4ddd-8c20-106cf2d1923f-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Flow 'volume_create_manager' (f3597e68-ee95-4d16-a907-cc1efec46db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8ee60a-c58c-41fe-b6ca-a72e254c6447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8ee60a-c58c-41fe-b6ca-a72e254c6447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2137013180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42daaa3f-2bb9-437a-a532-a8b88eddd29e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2790697ead0443f4b120c0fa7634938c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:56Z,use_quota=True,user_id='c727b04430f34e0595b2d7ca8c9d2057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66df4a9e-9c4d-4d2e-98f6-8f638f9cb120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66df4a9e-9c4d-4d2e-98f6-8f638f9cb120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af08e981-646b-4565-918f-6946df69b600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af08e981-646b-4565-918f-6946df69b600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42daaa3f-2bb9-437a-a532-a8b88eddd29e', 'volume_name': 'volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674e1d0a-bae9-425b-9497-73e35894d492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674e1d0a-bae9-425b-9497-73e35894d492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e9e611-0ab0-4c57-8f97-6247a4b03102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:56 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Volume 42daaa3f-2bb9-437a-a532-a8b88eddd29e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e', 'volume_size': 1}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2137013180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42daaa3f-2bb9-437a-a532-a8b88eddd29e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2790697ead0443f4b120c0fa7634938c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:56Z,use_quota=True,user_id='c727b04430f34e0595b2d7ca8c9d2057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Creating volume 42daaa3f-2bb9-437a-a532-a8b88eddd29e {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:18:56 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:18:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:56 devstack sudo[103223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e 1073741824
Nov 02 10:18:56 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:56 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e 1073741824" returned: 0 in 0.476s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:57 devstack sudo[103235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e
Nov 02 10:18:57 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:57 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e" returned: 0 in 0.301s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:18:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e9e611-0ab0-4c57-8f97-6247a4b03102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0da644-df58-4c3c-a273-5771284d03cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:57 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Volume volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e (42daaa3f-2bb9-437a-a532-a8b88eddd29e): created successfully
Nov 02 10:18:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0da644-df58-4c3c-a273-5771284d03cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Flow 'volume_create_manager' (f3597e68-ee95-4d16-a907-cc1efec46db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-da53ed00-a283-46fc-81b8-12e0aaff89cf tempest-VolumesListTestJSON-1501733671 None] Created volume successfully.
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Flow 'volume_create_manager' (9925f21f-711b-4c48-8380-a26fa6323146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3f42f2-f62f-4c58-888d-f616ae5d3aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3f42f2-f62f-4c58-888d-f616ae5d3aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593111129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd18cb8d-a384-4635-a818-4a46524aecb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97473b30b4074c43ab1e93a2ac039642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:58Z,use_quota=True,user_id='78690708df424d97b7b4dbb8ec0fc5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4db946-1f6a-43ca-8971-39fd03237bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4db946-1f6a-43ca-8971-39fd03237bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16e6c59-770f-404f-8ed8-eef080098157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16e6c59-770f-404f-8ed8-eef080098157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd18cb8d-a384-4635-a818-4a46524aecb0', 'volume_name': 'volume-cd18cb8d-a384-4635-a818-4a46524aecb0', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fbcfac-c00c-4d9f-905c-bcc11698d362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fbcfac-c00c-4d9f-905c-bcc11698d362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c44c4d8-b7dc-4bbf-ae8a-d4a0423bf902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:58 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Volume cd18cb8d-a384-4635-a818-4a46524aecb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd18cb8d-a384-4635-a818-4a46524aecb0', 'volume_size': 1}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593111129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd18cb8d-a384-4635-a818-4a46524aecb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97473b30b4074c43ab1e93a2ac039642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:58Z,use_quota=True,user_id='78690708df424d97b7b4dbb8ec0fc5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Creating volume cd18cb8d-a384-4635-a818-4a46524aecb0 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:18:58 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:58 devstack sudo[103238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0 1073741824
Nov 02 10:18:58 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:58 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0 1073741824" returned: 0 in 0.504s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:58 devstack sudo[103244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0
Nov 02 10:18:58 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Flow 'volume_create_manager' (1bb9b35b-2aef-4eeb-b6bc-744002688d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355f12fa-150c-47b8-b20d-0900e484e5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355f12fa-150c-47b8-b20d-0900e484e5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1968851910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a4fef7-1361-4810-8432-c42fd7013812,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2790697ead0443f4b120c0fa7634938c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:59Z,use_quota=True,user_id='c727b04430f34e0595b2d7ca8c9d2057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9bcee74-b36b-4f08-92a1-61e20f8e2864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9bcee74-b36b-4f08-92a1-61e20f8e2864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752db2f5-cd94-403a-8f3f-5dc2c6ac52f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752db2f5-cd94-403a-8f3f-5dc2c6ac52f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a4fef7-1361-4810-8432-c42fd7013812', 'volume_name': 'volume-c7a4fef7-1361-4810-8432-c42fd7013812', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1f04b6-f174-4b57-b9dd-8de716bc7631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:59 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1f04b6-f174-4b57-b9dd-8de716bc7631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd117d3b-7a11-4f18-8d7a-04bf51044a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:59 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Volume c7a4fef7-1361-4810-8432-c42fd7013812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a4fef7-1361-4810-8432-c42fd7013812', 'volume_size': 1}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0" returned: 0 in 0.354s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1968851910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a4fef7-1361-4810-8432-c42fd7013812,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2790697ead0443f4b120c0fa7634938c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:18:59Z,use_quota=True,user_id='c727b04430f34e0595b2d7ca8c9d2057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Creating volume c7a4fef7-1361-4810-8432-c42fd7013812 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:18:59 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c44c4d8-b7dc-4bbf-ae8a-d4a0423bf902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd18cb8d-a384-4635-a818-4a46524aecb0', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:59 devstack sudo[103247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812 1073741824
Nov 02 10:18:59 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5edfda77-3004-4220-bff6-492d14a958bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:59 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Volume volume-cd18cb8d-a384-4635-a818-4a46524aecb0 (cd18cb8d-a384-4635-a818-4a46524aecb0): created successfully
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5edfda77-3004-4220-bff6-492d14a958bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Flow 'volume_create_manager' (9925f21f-711b-4c48-8380-a26fa6323146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:18:59 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8e3ae29c-e00c-4ec8-bb47-d33d2ab00b12 tempest-ProjectReaderTests-814349954 None] Created volume successfully.
Nov 02 10:18:59 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812 1073741824" returned: 0 in 0.437s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:18:59 devstack sudo[103252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812
Nov 02 10:18:59 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:18:59 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812" returned: 0 in 0.247s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd117d3b-7a11-4f18-8d7a-04bf51044a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a4fef7-1361-4810-8432-c42fd7013812', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:18:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa32478-512c-43eb-987e-90ec8c4d8b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:18:59 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Volume volume-c7a4fef7-1361-4810-8432-c42fd7013812 (c7a4fef7-1361-4810-8432-c42fd7013812): created successfully
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa32478-512c-43eb-987e-90ec8c4d8b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Flow 'volume_create_manager' (1bb9b35b-2aef-4eeb-b6bc-744002688d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:19:00 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-801e9af6-b8b8-47ed-be84-f0e0c3ccb518 tempest-VolumesListTestJSON-1501733671 None] Created volume successfully.
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Acquiring lock "cinder-cd18cb8d-a384-4635-a818-4a46524aecb0-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Lock "cinder-cd18cb8d-a384-4635-a818-4a46524aecb0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Acquiring lock "cinder-quobyte-cd18cb8d-a384-4635-a818-4a46524aecb0" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Lock "cinder-quobyte-cd18cb8d-a384-4635-a818-4a46524aecb0" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2512aa8c-553c-423a-ad23-5a6d875c7ef1]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:00 devstack sudo[103255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0
Nov 02 10:19:00 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Flow 'volume_create_manager' (6791a198-1bb2-45a5-88af-162e7ad97b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60ac990-dd8d-4b6f-b96e-88cb12d94859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60ac990-dd8d-4b6f-b96e-88cb12d94859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1120266085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71e0e53-2ca2-41d4-b9d6-d966c8dded41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2790697ead0443f4b120c0fa7634938c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:01Z,use_quota=True,user_id='c727b04430f34e0595b2d7ca8c9d2057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d01ea44-b7df-41ef-b938-7dbe7c6d0afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d01ea44-b7df-41ef-b938-7dbe7c6d0afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebfbdeb-b34f-42f9-b24d-ec90b716e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebfbdeb-b34f-42f9-b24d-ec90b716e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71e0e53-2ca2-41d4-b9d6-d966c8dded41', 'volume_name': 'volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095ee8d6-f926-4099-8da3-46d4b9023687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095ee8d6-f926-4099-8da3-46d4b9023687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76afe10a-6c65-49cb-b606-26f91927fe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:00 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Volume c71e0e53-2ca2-41d4-b9d6-d966c8dded41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41', 'volume_size': 1}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1120266085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71e0e53-2ca2-41d4-b9d6-d966c8dded41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2790697ead0443f4b120c0fa7634938c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:01Z,use_quota=True,user_id='c727b04430f34e0595b2d7ca8c9d2057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Creating volume c71e0e53-2ca2-41d4-b9d6-d966c8dded41 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:19:00 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:19:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:01 devstack sudo[103257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41 1073741824
Nov 02 10:19:01 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:01 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0" returned: 0 in 0.409s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:01 devstack sudo[103262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0
Nov 02 10:19:01 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:01 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cd18cb8d-a384-4635-a818-4a46524aecb0" returned: 0 in 0.302s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Lock "cinder-quobyte-cd18cb8d-a384-4635-a818-4a46524aecb0" released by "delete_volume" :: held 0.762s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:01 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Created reservations ['2cd4fe45-dd5e-4e4b-abfa-e2a7671b1c7d', '95044205-29cf-4286-ae79-aaf9e39255b8', '9a7c58fa-fcc8-4e23-b652-dcad5720dbd8', '2069b0b7-eb53-4c2d-8700-bf851fd3db8d'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41 1073741824" returned: 0 in 0.510s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:01 devstack sudo[103270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41
Nov 02 10:19:01 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:01 devstack sudo[103272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:19:01 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:01 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41" returned: 0 in 0.268s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76afe10a-6c65-49cb-b606-26f91927fe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbbee77-750e-49a8-93aa-d8d57ea7fb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:01 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Volume volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41 (c71e0e53-2ca2-41d4-b9d6-d966c8dded41): created successfully
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbbee77-750e-49a8-93aa-d8d57ea7fb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Flow 'volume_create_manager' (6791a198-1bb2-45a5-88af-162e7ad97b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:19:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-353ce6ea-2fbe-429f-a4e0-56bb6d328d22 tempest-VolumesListTestJSON-1501733671 None] Created volume successfully.
Nov 02 10:19:01 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.394s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:01 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:19:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Deleted volume successfully.
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-794cc961-7f21-4edc-bb89-83f04155e564 tempest-ProjectReaderTests-814349954 None] Lock "cinder-cd18cb8d-a384-4635-a818-4a46524aecb0-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Flow 'volume_create_manager' (a42d9547-17f4-48c8-bec6-523610b4e8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c3487c-e9f2-4f36-b524-825537273fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c3487c-e9f2-4f36-b524-825537273fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-336518092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab42fef-9fc9-45a5-a819-07c445ffc11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97473b30b4074c43ab1e93a2ac039642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:02Z,use_quota=True,user_id='78690708df424d97b7b4dbb8ec0fc5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d24e12-8f9c-4bb1-8f24-c543ed7ff823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d24e12-8f9c-4bb1-8f24-c543ed7ff823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16fdf55e-d499-4edd-ae61-8b3305c4787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16fdf55e-d499-4edd-ae61-8b3305c4787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab42fef-9fc9-45a5-a819-07c445ffc11d', 'volume_name': 'volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227fbbd0-804d-4cc3-ab7c-57210bbde0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227fbbd0-804d-4cc3-ab7c-57210bbde0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c199e3-01ac-4a22-b180-a06531c1f2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:02 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Volume 0ab42fef-9fc9-45a5-a819-07c445ffc11d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d', 'volume_size': 1}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-336518092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab42fef-9fc9-45a5-a819-07c445ffc11d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97473b30b4074c43ab1e93a2ac039642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:02Z,use_quota=True,user_id='78690708df424d97b7b4dbb8ec0fc5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Creating volume 0ab42fef-9fc9-45a5-a819-07c445ffc11d {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:19:02 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:02 devstack sudo[103276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d 1073741824
Nov 02 10:19:02 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:02 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d 1073741824" returned: 0 in 0.420s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:02 devstack sudo[103281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d
Nov 02 10:19:02 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:03 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d" returned: 0 in 0.320s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c199e3-01ac-4a22-b180-a06531c1f2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6baae79d-c907-4162-a0cc-2af3d0eded27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:03 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Volume volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d (0ab42fef-9fc9-45a5-a819-07c445ffc11d): created successfully
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6baae79d-c907-4162-a0cc-2af3d0eded27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Flow 'volume_create_manager' (a42d9547-17f4-48c8-bec6-523610b4e8a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:19:03 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f2ba0fd3-a8bb-4f0b-8e93-e0f69a20da12 tempest-ProjectReaderTests-814349954 None] Created volume successfully.
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Acquiring lock "cinder-0ab42fef-9fc9-45a5-a819-07c445ffc11d-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Lock "cinder-0ab42fef-9fc9-45a5-a819-07c445ffc11d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Acquiring lock "cinder-quobyte-0ab42fef-9fc9-45a5-a819-07c445ffc11d" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Lock "cinder-quobyte-0ab42fef-9fc9-45a5-a819-07c445ffc11d" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a713f437-3c50-486e-b850-8f6d9f13e3a1]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:19:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:03 devstack sudo[103298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d
Nov 02 10:19:03 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:04 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d" returned: 0 in 0.462s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:04 devstack sudo[103303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d
Nov 02 10:19:04 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:04 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ab42fef-9fc9-45a5-a819-07c445ffc11d" returned: 0 in 0.268s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Lock "cinder-quobyte-0ab42fef-9fc9-45a5-a819-07c445ffc11d" released by "delete_volume" :: held 0.786s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Created reservations ['30f694f1-80b8-4767-a415-1f90eb27734d', '58c0e241-c2d2-48d1-925c-5e957f61616a', 'edc21ee4-e400-4533-807e-27c0a170fed6', 'a83a7a02-b1f4-4f86-8bde-d9bdddc84bf8'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:04 devstack sudo[103306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:19:04 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:04 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.299s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:19:04 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Deleted volume successfully.
Nov 02 10:19:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-472f71f0-3673-4680-bd30-86f8838b1b9b tempest-ProjectReaderTests-814349954 None] Lock "cinder-0ab42fef-9fc9-45a5-a819-07c445ffc11d-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "cinder-c71e0e53-2ca2-41d4-b9d6-d966c8dded41-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-c71e0e53-2ca2-41d4-b9d6-d966c8dded41-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Flow 'volume_create_manager' (546627b1-f504-4572-b1ca-21f3f06560ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0c212b-4990-4467-8d11-c7c89081f166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0c212b-4990-4467-8d11-c7c89081f166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370675426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79314986-c459-4691-b667-3155f4441cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97473b30b4074c43ab1e93a2ac039642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:05Z,use_quota=True,user_id='78690708df424d97b7b4dbb8ec0fc5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c05ed94-38b6-4320-995f-7849907d1e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c05ed94-38b6-4320-995f-7849907d1e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f220e2-cc91-40cb-8188-6dcd5b923e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f220e2-cc91-40cb-8188-6dcd5b923e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79314986-c459-4691-b667-3155f4441cbd', 'volume_name': 'volume-79314986-c459-4691-b667-3155f4441cbd', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af89967-0c27-4768-808f-8b2f176aa202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af89967-0c27-4768-808f-8b2f176aa202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f429dd63-ecf7-454f-aaea-df1a19c95fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:05 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Volume 79314986-c459-4691-b667-3155f4441cbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79314986-c459-4691-b667-3155f4441cbd', 'volume_size': 1}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1370675426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79314986-c459-4691-b667-3155f4441cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97473b30b4074c43ab1e93a2ac039642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:05Z,use_quota=True,user_id='78690708df424d97b7b4dbb8ec0fc5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Creating volume 79314986-c459-4691-b667-3155f4441cbd {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:19:05 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:05 devstack sudo[103335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd 1073741824
Nov 02 10:19:05 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "cinder-quobyte-c71e0e53-2ca2-41d4-b9d6-d966c8dded41" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-quobyte-c71e0e53-2ca2-41d4-b9d6-d966c8dded41" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[02943c91-ebb0-4013-bd01-995f2c4f9b40]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:05 devstack sudo[103337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41
Nov 02 10:19:05 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:05 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:05 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd 1073741824" returned: 0 in 0.489s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41" returned: 0 in 0.409s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:05 devstack sudo[103345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41
Nov 02 10:19:05 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:05 devstack sudo[103347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd
Nov 02 10:19:05 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:06 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c71e0e53-2ca2-41d4-b9d6-d966c8dded41" returned: 0 in 0.262s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-quobyte-c71e0e53-2ca2-41d4-b9d6-d966c8dded41" released by "delete_volume" :: held 0.720s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:06 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd" returned: 0 in 0.260s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f429dd63-ecf7-454f-aaea-df1a19c95fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79314986-c459-4691-b667-3155f4441cbd', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6f379d-93bf-4a0d-aa46-70506fb3ac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:06 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Volume volume-79314986-c459-4691-b667-3155f4441cbd (79314986-c459-4691-b667-3155f4441cbd): created successfully
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6f379d-93bf-4a0d-aa46-70506fb3ac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Flow 'volume_create_manager' (546627b1-f504-4572-b1ca-21f3f06560ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:19:06 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ba3675f7-324c-4ba5-a3be-90cc70e41b43 tempest-ProjectReaderTests-814349954 None] Created volume successfully.
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Created reservations ['066e983e-a811-44d9-9eee-62df797a5442', 'ddfe13cb-c6c2-446b-b8ff-7d48ff9baa94', '532dd01f-3b58-4dbe-bcc6-7f55d701ebc1', '1f6b8fab-6870-46ae-91cb-26c549313c64'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:06 devstack sudo[103351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:19:06 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "cinder-c7a4fef7-1361-4810-8432-c42fd7013812-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-c7a4fef7-1361-4810-8432-c42fd7013812-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "cinder-quobyte-c7a4fef7-1361-4810-8432-c42fd7013812" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-quobyte-c7a4fef7-1361-4810-8432-c42fd7013812" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[828186ed-60e1-4803-986f-4bb28bb85ff1]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:06 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.279s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:19:06 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Deleted volume successfully.
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c0c3f8cc-6487-4c16-bd50-ea134308a10b tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-c71e0e53-2ca2-41d4-b9d6-d966c8dded41-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:06 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812
Nov 02 10:19:06 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:06 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812" returned: 0 in 0.358s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:06 devstack sudo[103359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812
Nov 02 10:19:06 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:07 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c7a4fef7-1361-4810-8432-c42fd7013812" returned: 0 in 0.253s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-quobyte-c7a4fef7-1361-4810-8432-c42fd7013812" released by "delete_volume" :: held 0.651s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Created reservations ['af95adb1-bb57-4c2e-924b-c975c04efad7', 'eefdb07e-179c-426b-a58d-e523dcb4be31', '4d5feb94-4c98-48b5-8b68-27321786ead9', '04d82f3c-1355-4303-b6c8-4c5a6cd177b9'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:07 devstack sudo[103362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:19:07 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:07 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:19:07 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Acquiring lock "cinder-79314986-c459-4691-b667-3155f4441cbd-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Lock "cinder-79314986-c459-4691-b667-3155f4441cbd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Acquiring lock "cinder-quobyte-79314986-c459-4691-b667-3155f4441cbd" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Lock "cinder-quobyte-79314986-c459-4691-b667-3155f4441cbd" acquired by "delete_volume" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bf92f0-b8ec-41e3-a5d9-0e2dc9211d7f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:07 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.320s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:19:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Deleted volume successfully.
Nov 02 10:19:07 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.298s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c443b222-89f6-4fff-9270-84de6bfc9685 tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-c7a4fef7-1361-4810-8432-c42fd7013812-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:07 devstack sudo[103366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd
Nov 02 10:19:07 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "cinder-42daaa3f-2bb9-437a-a532-a8b88eddd29e-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-42daaa3f-2bb9-437a-a532-a8b88eddd29e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "cinder-quobyte-42daaa3f-2bb9-437a-a532-a8b88eddd29e" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-quobyte-42daaa3f-2bb9-437a-a532-a8b88eddd29e" acquired by "delete_volume" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a580810-8f05-49e9-9a15-81aae4823b0e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:07 devstack sudo[103370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e
Nov 02 10:19:07 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:07 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd" returned: 0 in 0.426s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:07 devstack sudo[103375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd
Nov 02 10:19:07 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:08 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:08 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e" returned: 0 in 0.399s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-79314986-c459-4691-b667-3155f4441cbd" returned: 0 in 0.273s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Lock "cinder-quobyte-79314986-c459-4691-b667-3155f4441cbd" released by "delete_volume" :: held 0.763s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:08 devstack sudo[103381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e
Nov 02 10:19:08 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Created reservations ['2ae4a4f0-721e-4366-bbb9-883fc0d7c443', 'f5dcb52f-0bd3-44f6-9f67-aacfa911286f', 'd1b6a824-6de6-4b63-8462-7275af6465a3', '73fe8a57-594c-4860-8735-9a8f9cbc2c31'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:08 devstack sudo[103383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:19:08 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:08 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-42daaa3f-2bb9-437a-a532-a8b88eddd29e" returned: 0 in 0.329s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-quobyte-42daaa3f-2bb9-437a-a532-a8b88eddd29e" released by "delete_volume" :: held 0.778s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:08 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.289s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:19:08 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Deleted volume successfully.
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Created reservations ['dedbc8d4-173c-45e8-a4aa-c7e847ee8562', '39ea048d-2606-4c7b-b62d-2995b6e2626f', 'fd58a87f-d6ce-46ef-81a9-ed067a5724ec', '83e3d4b0-cb2c-44a3-abf4-a2fd92ead87d'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fba45351-3bd7-43cd-a273-8c77c329083d tempest-ProjectReaderTests-814349954 None] Lock "cinder-79314986-c459-4691-b667-3155f4441cbd-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:08 devstack sudo[103388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:19:08 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:09 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.298s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:19:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Deleted volume successfully.
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Flow 'volume_create_manager' (ae257f4b-9b7d-495d-ad92-4818ae1be033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a26c69d-634e-48c4-8719-6718b3eaeb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7c0d5c5-fab9-49e5-b32c-d931925b2ccb tempest-VolumesListTestJSON-1501733671 None] Lock "cinder-42daaa3f-2bb9-437a-a532-a8b88eddd29e-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a26c69d-634e-48c4-8719-6718b3eaeb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765779976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a29f098-79ea-4dce-b799-30043320e7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97473b30b4074c43ab1e93a2ac039642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:09Z,use_quota=True,user_id='78690708df424d97b7b4dbb8ec0fc5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79c3399-ee2c-4f69-9507-865cb626968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79c3399-ee2c-4f69-9507-865cb626968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96692b89-a91a-462b-bbf7-e5fe60d374b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96692b89-a91a-462b-bbf7-e5fe60d374b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a29f098-79ea-4dce-b799-30043320e7ea', 'volume_name': 'volume-7a29f098-79ea-4dce-b799-30043320e7ea', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244c090a-4b67-4f9d-b4dd-8a3900e32f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244c090a-4b67-4f9d-b4dd-8a3900e32f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697fb276-3f99-4243-b6f3-a61686a9109c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:09 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Volume 7a29f098-79ea-4dce-b799-30043320e7ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a29f098-79ea-4dce-b799-30043320e7ea', 'volume_size': 1}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765779976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a29f098-79ea-4dce-b799-30043320e7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97473b30b4074c43ab1e93a2ac039642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:09Z,use_quota=True,user_id='78690708df424d97b7b4dbb8ec0fc5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Creating volume 7a29f098-79ea-4dce-b799-30043320e7ea {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:19:09 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:09 devstack sudo[103391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea 1073741824
Nov 02 10:19:09 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:09 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea 1073741824" returned: 0 in 0.550s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:09 devstack sudo[103397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea
Nov 02 10:19:09 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:10 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea" returned: 0 in 0.339s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:19:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697fb276-3f99-4243-b6f3-a61686a9109c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a29f098-79ea-4dce-b799-30043320e7ea', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaf6374-46c5-4200-9787-5dc1f5093675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:10 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Volume volume-7a29f098-79ea-4dce-b799-30043320e7ea (7a29f098-79ea-4dce-b799-30043320e7ea): created successfully
Nov 02 10:19:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaf6374-46c5-4200-9787-5dc1f5093675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Flow 'volume_create_manager' (ae257f4b-9b7d-495d-ad92-4818ae1be033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:19:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fdc01d9f-a5a5-4ea0-982d-442f1506f28e tempest-ProjectReaderTests-814349954 None] Created volume successfully.
Nov 02 10:19:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Acquiring lock "cinder-7a29f098-79ea-4dce-b799-30043320e7ea-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Lock "cinder-7a29f098-79ea-4dce-b799-30043320e7ea-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Acquiring lock "cinder-quobyte-7a29f098-79ea-4dce-b799-30043320e7ea" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Lock "cinder-quobyte-7a29f098-79ea-4dce-b799-30043320e7ea" acquired by "delete_volume" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:11 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc2a0ed-6d93-4610-9653-6b3a77dc9b2f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:19:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:11 devstack sudo[103401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea
Nov 02 10:19:11 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:11 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea" returned: 0 in 0.387s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:11 devstack sudo[103406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea
Nov 02 10:19:11 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:11 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a29f098-79ea-4dce-b799-30043320e7ea" returned: 0 in 0.254s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Lock "cinder-quobyte-7a29f098-79ea-4dce-b799-30043320e7ea" released by "delete_volume" :: held 0.689s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:12 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Created reservations ['38d60c88-40fb-4608-8b37-e1c23a587c40', '35a90e37-7d5c-4d6a-a6b4-4072c9b834c3', 'db56c6a2-44f1-4386-b833-57740f639c69', '0e94937f-df9c-4fa3-95c0-423f1523fbfa'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:19:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:12 devstack sudo[103409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:19:12 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:12 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.277s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:12 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:19:12 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Deleted volume successfully.
Nov 02 10:19:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-62243e46-2943-489e-bef0-22b2245550e8 tempest-ProjectReaderTests-814349954 None] Lock "cinder-7a29f098-79ea-4dce-b799-30043320e7ea-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:22 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=81,cinder:UPDATE=112,cinder:INSERT=27,cinder:DELETE=11 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:19:25 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=83,cinder:UPDATE=109,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:19:28 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-628ed7f3-9564-48a5-a704-0eeaecb83f40 tempest-TestShelveInstance-2143570346 None] Terminate volume connection completed successfully.
Nov 02 10:19:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-628ed7f3-9564-48a5-a704-0eeaecb83f40 tempest-TestShelveInstance-2143570346 None] Deleting attachment cab49be1-fe63-43b9-ba5d-3d22a5462aee. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:19:29 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Acquiring lock "cinder-7025f57b-c6e3-4986-845d-52b13d47249c-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:29 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Lock "cinder-7025f57b-c6e3-4986-845d-52b13d47249c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:29 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Acquiring lock "cinder-quobyte-7025f57b-c6e3-4986-845d-52b13d47249c" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:19:29 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Lock "cinder-quobyte-7025f57b-c6e3-4986-845d-52b13d47249c" acquired by "delete_volume" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:19:29 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4c6c21-ee4b-4d4b-a4f6-fe6aa7e8492b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:19:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:29 devstack sudo[103481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c
Nov 02 10:19:29 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:29 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c" returned: 0 in 0.542s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:29 devstack sudo[103486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c
Nov 02 10:19:29 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:30 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7025f57b-c6e3-4986-845d-52b13d47249c" returned: 0 in 0.349s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Lock "cinder-quobyte-7025f57b-c6e3-4986-845d-52b13d47249c" released by "delete_volume" :: held 0.957s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG cinder.quota [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Created reservations ['e95bcf0c-9da0-4c17-8269-f63a8457e2db', 'e74fbb34-8b93-4672-bf46-afc67618c80b', 'ceb54328-c3a9-42d9-a710-7faa95eed001', 'b247b499-3587-4c9b-aa44-7b75d3191091'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:30 devstack sudo[103489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:19:30 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:30 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.325s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG cinder.manager [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:19:30 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Deleted volume successfully.
Nov 02 10:19:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [req-582a07b4-bfd4-42e9-9ee4-328c33f6e594 req-a2814072-53fc-4485-a5e6-3b3a3445518c tempest-TestShelveInstance-2143570346 None] Lock "cinder-7025f57b-c6e3-4986-845d-52b13d47249c-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:19:40 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:19:40 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Flow 'volume_create_manager' (a0a120b6-161c-4cc6-a9ce-712f50d56b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afda8ac0-b5d9-4393-99e9-ed574621fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afda8ac0-b5d9-4393-99e9-ed574621fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-623276392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c513413e-1317-47b1-a7bc-28759ac5fa4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16a0ba5c17c4a6abfc16f7f97ce23b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:45Z,use_quota=True,user_id='521401b5406d4976b9f9b348c4ea98a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f06b11-ebd1-4a18-b08b-598bf505b5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f06b11-ebd1-4a18-b08b-598bf505b5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87911c3c-5c4d-4c08-a06b-7dfc206d8930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87911c3c-5c4d-4c08-a06b-7dfc206d8930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c513413e-1317-47b1-a7bc-28759ac5fa4e', 'volume_name': 'volume-c513413e-1317-47b1-a7bc-28759ac5fa4e', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe1ad43-9d9a-4973-976e-a938dd35bfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe1ad43-9d9a-4973-976e-a938dd35bfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308c413e-3d28-43e3-8a38-6a6d2137238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:45 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Volume c513413e-1317-47b1-a7bc-28759ac5fa4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c513413e-1317-47b1-a7bc-28759ac5fa4e', 'volume_size': 1}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-623276392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c513413e-1317-47b1-a7bc-28759ac5fa4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16a0ba5c17c4a6abfc16f7f97ce23b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:19:45Z,use_quota=True,user_id='521401b5406d4976b9f9b348c4ea98a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Creating volume c513413e-1317-47b1-a7bc-28759ac5fa4e {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:19:45 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:19:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:45 devstack sudo[103600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e 1073741824
Nov 02 10:19:45 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:46 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e 1073741824" returned: 0 in 0.556s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:19:46 devstack sudo[103606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e
Nov 02 10:19:46 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:19:46 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root
Nov 02 10:19:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e" returned: 0 in 0.300s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:19:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:19:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308c413e-3d28-43e3-8a38-6a6d2137238e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c513413e-1317-47b1-a7bc-28759ac5fa4e', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5d835a-cad7-4a18-a0c4-e3f24feb4ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:19:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Volume volume-c513413e-1317-47b1-a7bc-28759ac5fa4e (c513413e-1317-47b1-a7bc-28759ac5fa4e): created successfully
Nov 02 10:19:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5d835a-cad7-4a18-a0c4-e3f24feb4ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:19:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Flow 'volume_create_manager' (a0a120b6-161c-4cc6-a9ce-712f50d56b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:19:46 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-7538fa6e-b83a-478f-90ad-b9e7dd2c8d1d tempest-TestMinimumBasicScenario-1480737115 None] Created volume successfully.
Nov 02 10:19:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-a472aa56-eec8-413a-8e26-45c4559a44ee req-e233be11-3c3e-48de-a1e4-13aefeeb8acb tempest-TestMinimumBasicScenario-1480737115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:19:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-a472aa56-eec8-413a-8e26-45c4559a44ee req-e233be11-3c3e-48de-a1e4-13aefeeb8acb tempest-TestMinimumBasicScenario-1480737115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:19:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-a472aa56-eec8-413a-8e26-45c4559a44ee req-e233be11-3c3e-48de-a1e4-13aefeeb8acb tempest-TestMinimumBasicScenario-1480737115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:19:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-a472aa56-eec8-413a-8e26-45c4559a44ee req-e233be11-3c3e-48de-a1e4-13aefeeb8acb tempest-TestMinimumBasicScenario-1480737115 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-c513413e-1317-47b1-a7bc-28759ac5fa4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae454c0d-f228-42a0-af9f-879040f1a1fd', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:19:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-a472aa56-eec8-413a-8e26-45c4559a44ee req-e233be11-3c3e-48de-a1e4-13aefeeb8acb tempest-TestMinimumBasicScenario-1480737115 None] attachment_update completed successfully.
Nov 02 10:19:58 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:19:58 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:07 devstack sudo[104074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:20:07 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:07 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.254s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:20:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:20:14 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:20:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Flow 'volume_create_manager' (d17d56f9-b634-4e61-b3cd-ddd4a631e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:20:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d486c886-4dfa-489f-80e6-24e6dc50fbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:20:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d486c886-4dfa-489f-80e6-24e6dc50fbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-320001430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2446d97e-65d2-4264-afe6-7e2d95fc9b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c7d525130c481492b70a0e9097341f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:15Z,use_quota=True,user_id='78f0ee710e4a41fb8dc4ef35a58cff3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:20:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57e07da-7f0c-4769-8b6b-d85a28a8e9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:20:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57e07da-7f0c-4769-8b6b-d85a28a8e9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:20:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1c1cf2-0fa0-4afa-8848-20133859db1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:20:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1c1cf2-0fa0-4afa-8848-20133859db1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2446d97e-65d2-4264-afe6-7e2d95fc9b4b', 'volume_name': 'volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:20:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d1f6d3-90d4-4025-a952-c69db326f772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d1f6d3-90d4-4025-a952-c69db326f772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fb2be1-aed2-4c2b-a13e-38ee22598018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:20:15 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Volume 2446d97e-65d2-4264-afe6-7e2d95fc9b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b', 'volume_size': 1}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-320001430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2446d97e-65d2-4264-afe6-7e2d95fc9b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c7d525130c481492b70a0e9097341f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:20:15Z,use_quota=True,user_id='78f0ee710e4a41fb8dc4ef35a58cff3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Creating volume 2446d97e-65d2-4264-afe6-7e2d95fc9b4b {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:20:15 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:15 devstack sudo[104137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b 1073741824
Nov 02 10:20:15 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:15 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b 1073741824" returned: 0 in 0.497s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:15 devstack sudo[104143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b
Nov 02 10:20:15 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:15 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" returned: 0 in 0.323s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fb2be1-aed2-4c2b-a13e-38ee22598018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb0a686-49d8-4b19-9240-ee971d9b253b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:20:15 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Volume volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b (2446d97e-65d2-4264-afe6-7e2d95fc9b4b): created successfully
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb0a686-49d8-4b19-9240-ee971d9b253b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:20:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Flow 'volume_create_manager' (d17d56f9-b634-4e61-b3cd-ddd4a631e14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:20:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-abd63b6c-fc59-4828-ab8f-7c2baf269c41 tempest-TestStampPattern-1893337203 None] Created volume successfully.
Nov 02 10:20:25 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:20:25 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:20:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-dcbb9bd5-0062-424e-bc5f-2f97b8a0cadb req-66ad0a05-f12d-4988-86bc-8ddec5315f9d tempest-TestStampPattern-1893337203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:20:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-dcbb9bd5-0062-424e-bc5f-2f97b8a0cadb req-66ad0a05-f12d-4988-86bc-8ddec5315f9d tempest-TestStampPattern-1893337203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:20:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-dcbb9bd5-0062-424e-bc5f-2f97b8a0cadb req-66ad0a05-f12d-4988-86bc-8ddec5315f9d tempest-TestStampPattern-1893337203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:20:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-dcbb9bd5-0062-424e-bc5f-2f97b8a0cadb req-66ad0a05-f12d-4988-86bc-8ddec5315f9d tempest-TestStampPattern-1893337203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d8ab727-12cb-40ba-8d99-286a23366055', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:20:46 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-dcbb9bd5-0062-424e-bc5f-2f97b8a0cadb req-66ad0a05-f12d-4988-86bc-8ddec5315f9d tempest-TestStampPattern-1893337203 None] attachment_update completed successfully.
Nov 02 10:20:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-2259e98e-3282-47e3-ad1a-0346c62070fc req-5ffcc80d-c6bc-45ff-9c0d-3fbd4d4b94a8 tempest-TestMinimumBasicScenario-1480737115 None] Terminate volume connection completed successfully.
Nov 02 10:20:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-2259e98e-3282-47e3-ad1a-0346c62070fc req-5ffcc80d-c6bc-45ff-9c0d-3fbd4d4b94a8 tempest-TestMinimumBasicScenario-1480737115 None] Deleting attachment ae454c0d-f228-42a0-af9f-879040f1a1fd. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:20:51 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-7834ecea-be34-4d43-bb9c-b2072b8fe8c9 req-8e14f552-3d07-4751-b684-c0fa4d09dd20 tempest-TestStampPattern-1893337203 None] Terminate volume connection completed successfully.
Nov 02 10:20:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-7834ecea-be34-4d43-bb9c-b2072b8fe8c9 req-8e14f552-3d07-4751-b684-c0fa4d09dd20 tempest-TestStampPattern-1893337203 None] Deleting attachment 5d8ab727-12cb-40ba-8d99-286a23366055. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:20:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Acquiring lock "cinder-c513413e-1317-47b1-a7bc-28759ac5fa4e-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:20:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Lock "cinder-c513413e-1317-47b1-a7bc-28759ac5fa4e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:20:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Acquiring lock "cinder-quobyte-c513413e-1317-47b1-a7bc-28759ac5fa4e" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:20:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Lock "cinder-quobyte-c513413e-1317-47b1-a7bc-28759ac5fa4e" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:20:51 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[754dc75d-3bbc-4b4a-8e5c-3a2e6611edfa]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:20:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:51 devstack sudo[104363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e
Nov 02 10:20:51 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:52 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e" returned: 0 in 0.373s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:52 devstack sudo[104368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e
Nov 02 10:20:52 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:52 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c513413e-1317-47b1-a7bc-28759ac5fa4e" returned: 0 in 0.338s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Lock "cinder-quobyte-c513413e-1317-47b1-a7bc-28759ac5fa4e" released by "delete_volume" :: held 0.762s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] Creating offline snapshot 598cd369-cf52-4b40-8d57-596f3071be6d of volume 2446d97e-65d2-4264-afe6-7e2d95fc9b4b {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c16d7a-339d-463e-a92b-c44757883f5e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Created reservations ['5392c6cd-36b1-48ab-ac59-026dd8bff33d', '9be816f6-1ad3-4d7d-971b-5412c8bf37b8', '3a0e62a3-2930-4440-b3cc-9f7d6efab089', '48272a88-f36a-43c7-991f-e0dd74ae9547'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:52 devstack sudo[104371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b
Nov 02 10:20:52 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:52 devstack sudo[104372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:20:52 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:52 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.281s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:20:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Deleted volume successfully.
Nov 02 10:20:52 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6ca5844b-3b90-40dd-b931-e6a7580647cd tempest-TestMinimumBasicScenario-1480737115 None] Lock "cinder-c513413e-1317-47b1-a7bc-28759ac5fa4e-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" returned: 0 in 0.449s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:52 devstack sudo[104379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d 1G
Nov 02 10:20:52 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:53 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d 1G" returned: 0 in 0.622s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:53 devstack sudo[104406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d
Nov 02 10:20:53 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:53 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d" returned: 0 in 0.351s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:53 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d is being set with open permissions: ugo+rw
Nov 02 10:20:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:53 devstack sudo[104412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d
Nov 02 10:20:53 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:54 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d" returned: 0 in 0.298s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:54 devstack sudo[104417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.info
Nov 02 10:20:54 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:54 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.info" returned: 0 in 0.298s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:54 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.info is being set with open permissions: ugo+rw
Nov 02 10:20:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:20:54 devstack sudo[104420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.info
Nov 02 10:20:54 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:20:54 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root
Nov 02 10:20:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.info" returned: 0 in 0.266s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:20:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:20:54 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-bb364332-9b13-4705-a1f5-a8abeeacc64e tempest-TestStampPattern-1893337203 None] Create snapshot completed successfully
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Flow 'volume_create_manager' (78564158-4f04-4c48-8200-8f9b7cecc89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d61cb3-9633-49df-ab60-6dbfde51fc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d61cb3-9633-49df-ab60-6dbfde51fc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-570594990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a0e374-5a24-4fbf-985d-57f4a1003b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c7d525130c481492b70a0e9097341f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=598cd369-cf52-4b40-8d57-596f3071be6d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:03Z,use_quota=True,user_id='78f0ee710e4a41fb8dc4ef35a58cff3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f145fc38-73c7-4d73-8ada-d1bff7d30e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f145fc38-73c7-4d73-8ada-d1bff7d30e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727e2c3e-88ce-425d-85da-00a086853011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727e2c3e-88ce-425d-85da-00a086853011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd9a0e374-5a24-4fbf-985d-57f4a1003b72', 'volume_name': 'volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72', 'volume_size': 1, 'snapshot_id': '598cd369-cf52-4b40-8d57-596f3071be6d'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac40f15-0267-4a99-9088-9425be56f72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac40f15-0267-4a99-9088-9425be56f72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb89fd7-2b62-4fb6-a71e-86b9a4cc55e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:02 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Volume d9a0e374-5a24-4fbf-985d-57f4a1003b72: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72', 'volume_size': 1, 'snapshot_id': '598cd369-cf52-4b40-8d57-596f3071be6d'}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Acquiring lock "cinder-quobyte-598cd369-cf52-4b40-8d57-596f3071be6d-d9a0e374-5a24-4fbf-985d-57f4a1003b72" by "_create_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-598cd369-cf52-4b40-8d57-596f3071be6d-d9a0e374-5a24-4fbf-985d-57f4a1003b72" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Creating volume d9a0e374-5a24-4fbf-985d-57f4a1003b72 from snapshot 598cd369-cf52-4b40-8d57-596f3071be6d {{(pid=87014) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Acquiring lock "cinder-quobyte-d9a0e374-5a24-4fbf-985d-57f4a1003b72" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-d9a0e374-5a24-4fbf-985d-57f4a1003b72" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] snapshot: 598cd369-cf52-4b40-8d57-596f3071be6d, volume: d9a0e374-5a24-4fbf-985d-57f4a1003b72,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afbbe94-5f8c-4abf-863a-d32d4f503aa6]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:21:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:21:03 devstack sudo[104460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d
Nov 02 10:21:03 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:21:03 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root
Nov 02 10:21:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d" returned: 0 in 0.439s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:21:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:21:03 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[483839b7-e170-4138-9bea-a79e258da7b8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:21:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:21:03 devstack sudo[104465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b
Nov 02 10:21:03 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:21:03 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root
Nov 02 10:21:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" returned: 0 in 0.507s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:21:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:21:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:21:03 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72 not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:21:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:21:03 devstack sudo[104474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72
Nov 02 10:21:03 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:21:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:21:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:21:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:21:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:21:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:21:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:21:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:21:07 devstack sudo[104488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:21:07 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:21:08 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root
Nov 02 10:21:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.733s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:21:08 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:21:08 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:21:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:21:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:21:12 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=21,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:21:12 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=17,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:21:14 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root
Nov 02 10:21:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72" returned: 0 in 10.800s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:21:14 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b, size 1024.00 MB, duration 10.80 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:21:14 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Converted 1024.00 MB image at 94.78 MB/s
Nov 02 10:21:14 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72 is being set with open permissions: ugo+rw
Nov 02 10:21:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:21:14 devstack sudo[104563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72
Nov 02 10:21:14 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:21:15 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root
Nov 02 10:21:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72" returned: 0 in 0.403s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:21:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-d9a0e374-5a24-4fbf-985d-57f4a1003b72" released by "_copy_volume_from_snapshot" :: held 12.272s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:21:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-598cd369-cf52-4b40-8d57-596f3071be6d-d9a0e374-5a24-4fbf-985d-57f4a1003b72" released by "_create_volume_from_snapshot" :: held 12.389s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:21:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.411s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:21:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb89fd7-2b62-4fb6-a71e-86b9a4cc55e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72', 'volume_size': 1, 'snapshot_id': '598cd369-cf52-4b40-8d57-596f3071be6d'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693b10d8-2247-4d51-a249-e6820395ce4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:15 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Volume volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72 (d9a0e374-5a24-4fbf-985d-57f4a1003b72): created successfully
Nov 02 10:21:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693b10d8-2247-4d51-a249-e6820395ce4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Flow 'volume_create_manager' (78564158-4f04-4c48-8200-8f9b7cecc89f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:21:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c69ee2d9-a819-41f2-b7d5-35a8ef7b3047 tempest-TestStampPattern-1893337203 None] Created volume successfully.
Nov 02 10:21:25 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:21:25 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Flow 'volume_create_manager' (b33754b9-ee00-4156-9aa1-7fef35f06b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776b53d9-e940-40ad-b195-074ae75151ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776b53d9-e940-40ad-b195-074ae75151ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1245236088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5062514-82da-4833-b00b-07b160fdec61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf275a9f28346d0b93aebe683c28f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:36Z,use_quota=True,user_id='b2003f0378a64bbfb758b36193b0dfdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1334b564-a444-4459-82bd-f585aaad5356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1334b564-a444-4459-82bd-f585aaad5356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076346e2-b09d-4f61-8a1d-e31686ab2a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076346e2-b09d-4f61-8a1d-e31686ab2a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5062514-82da-4833-b00b-07b160fdec61', 'volume_name': 'volume-c5062514-82da-4833-b00b-07b160fdec61', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6589640f-968e-490a-bdb8-a446602f652e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6589640f-968e-490a-bdb8-a446602f652e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e4d9ed-7074-4f97-9e29-25d2e30df612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:36 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Volume c5062514-82da-4833-b00b-07b160fdec61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5062514-82da-4833-b00b-07b160fdec61', 'volume_size': 1}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1245236088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5062514-82da-4833-b00b-07b160fdec61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf275a9f28346d0b93aebe683c28f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:36Z,use_quota=True,user_id='b2003f0378a64bbfb758b36193b0dfdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Creating volume c5062514-82da-4833-b00b-07b160fdec61 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:21:36 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:21:36 devstack sudo[104635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61 1073741824
Nov 02 10:21:36 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Flow 'volume_create_manager' (e53d9551-ddd8-4d8f-a546-b5a43eababe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4162a57f-8124-435a-8f34-586a2a74258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4162a57f-8124-435a-8f34-586a2a74258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1150021305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2a6ad0-12c9-4de8-8616-2629656ef95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf275a9f28346d0b93aebe683c28f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:37Z,use_quota=True,user_id='b2003f0378a64bbfb758b36193b0dfdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae05f20-e456-40c9-9675-776a7e47a843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae05f20-e456-40c9-9675-776a7e47a843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af06d6de-816d-4b4a-a55b-30247a6fc523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af06d6de-816d-4b4a-a55b-30247a6fc523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd2a6ad0-12c9-4de8-8616-2629656ef95b', 'volume_name': 'volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd02fc9-615d-4215-a801-8e96870792bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd02fc9-615d-4215-a801-8e96870792bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3612d69-ac67-490e-8c23-ac5a902eadf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:36 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Volume dd2a6ad0-12c9-4de8-8616-2629656ef95b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b', 'volume_size': 1}
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:21:36 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root
Nov 02 10:21:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61 1073741824" returned: 0 in 0.535s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:21:37 devstack sudo[104641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61
Nov 02 10:21:37 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:21:37 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61" returned: 0 in 0.257s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1150021305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2a6ad0-12c9-4de8-8616-2629656ef95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf275a9f28346d0b93aebe683c28f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:21:37Z,use_quota=True,user_id='b2003f0378a64bbfb758b36193b0dfdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Creating volume dd2a6ad0-12c9-4de8-8616-2629656ef95b {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:21:37 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:21:37 devstack sudo[104644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b 1073741824
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e4d9ed-7074-4f97-9e29-25d2e30df612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5062514-82da-4833-b00b-07b160fdec61', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:37 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bd6a73-6735-44fb-a0b0-4af0381fb09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:37 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Volume volume-c5062514-82da-4833-b00b-07b160fdec61 (c5062514-82da-4833-b00b-07b160fdec61): created successfully
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bd6a73-6735-44fb-a0b0-4af0381fb09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Flow 'volume_create_manager' (b33754b9-ee00-4156-9aa1-7fef35f06b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:21:37 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d2dcfcb9-98a5-4050-ac39-9cf2a8b5df7d tempest-TestServerVolumeAttachmentScenario-1521245445 None] Created volume successfully.
Nov 02 10:21:37 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b 1073741824" returned: 0 in 0.518s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:21:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:21:37 devstack sudo[104650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b
Nov 02 10:21:37 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:21:38 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root
Nov 02 10:21:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b" returned: 0 in 0.256s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:21:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:21:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:21:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3612d69-ac67-490e-8c23-ac5a902eadf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c3bd8f-b1c7-4507-962d-9a42b13bc6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:21:38 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Volume volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b (dd2a6ad0-12c9-4de8-8616-2629656ef95b): created successfully
Nov 02 10:21:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c3bd8f-b1c7-4507-962d-9a42b13bc6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:21:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Flow 'volume_create_manager' (e53d9551-ddd8-4d8f-a546-b5a43eababe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:21:38 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-48e390fb-7fdb-40ef-a294-c5e5f1c1e7ac tempest-TestServerVolumeAttachmentScenario-1521245445 None] Created volume successfully.
Nov 02 10:21:48 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:UPDATE=5,cinder:SELECT=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:21:48 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:21:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-3bb955ff-2991-43c4-b1d8-698c9b733b48 req-85112858-5d2d-4c13-8341-79995c598538 tempest-TestStampPattern-1893337203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:21:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-3bb955ff-2991-43c4-b1d8-698c9b733b48 req-85112858-5d2d-4c13-8341-79995c598538 tempest-TestStampPattern-1893337203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:21:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-3bb955ff-2991-43c4-b1d8-698c9b733b48 req-85112858-5d2d-4c13-8341-79995c598538 tempest-TestStampPattern-1893337203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:21:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-3bb955ff-2991-43c4-b1d8-698c9b733b48 req-85112858-5d2d-4c13-8341-79995c598538 tempest-TestStampPattern-1893337203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e714434-542e-445f-92da-73c18c028c5d', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:21:56 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-3bb955ff-2991-43c4-b1d8-698c9b733b48 req-85112858-5d2d-4c13-8341-79995c598538 tempest-TestStampPattern-1893337203 None] attachment_update completed successfully.
Nov 02 10:22:00 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-b487396d-1176-4ea6-b48e-4fe40b78a10c req-ec3e0fa7-1e63-49a3-90be-37f775807b74 tempest-TestStampPattern-1893337203 None] Terminate volume connection completed successfully.
Nov 02 10:22:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-b487396d-1176-4ea6-b48e-4fe40b78a10c req-ec3e0fa7-1e63-49a3-90be-37f775807b74 tempest-TestStampPattern-1893337203 None] Deleting attachment 7e714434-542e-445f-92da-73c18c028c5d. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:22:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Acquiring lock "cinder-d9a0e374-5a24-4fbf-985d-57f4a1003b72-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Lock "cinder-d9a0e374-5a24-4fbf-985d-57f4a1003b72-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Acquiring lock "cinder-quobyte-d9a0e374-5a24-4fbf-985d-57f4a1003b72" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-d9a0e374-5a24-4fbf-985d-57f4a1003b72" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:04 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd05434-6fde-4b14-b7db-da8e295e29f1]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:04 devstack sudo[105274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72
Nov 02 10:22:04 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:04 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72" returned: 0 in 0.377s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:04 devstack sudo[105280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72
Nov 02 10:22:04 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:04 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d9a0e374-5a24-4fbf-985d-57f4a1003b72" returned: 0 in 0.270s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-d9a0e374-5a24-4fbf-985d-57f4a1003b72" released by "delete_volume" :: held 0.697s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:04 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Created reservations ['3d9bb571-b893-4cf8-8fd9-4f72d4ed61ab', 'a2240d94-8738-4b56-a060-36509365d5ce', 'fb68eebb-2faf-4d5b-b703-b416ca0d2c69', 'b4ca9b61-2f1d-4e0e-aa3f-bf1b6fa6366c'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:05 devstack sudo[105284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:05 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:05 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.300s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:05 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Deleted volume successfully.
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-bb8666a1-73a7-4440-94d7-51b7d4917ef4 tempest-TestStampPattern-1893337203 None] Lock "cinder-d9a0e374-5a24-4fbf-985d-57f4a1003b72-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Acquiring lock "cinder-598cd369-cf52-4b40-8d57-596f3071be6d-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Lock "cinder-598cd369-cf52-4b40-8d57-596f3071be6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Acquiring lock "cinder-quobyte-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Acquiring lock "cinder-quobyte-598cd369-cf52-4b40-8d57-596f3071be6d" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-598cd369-cf52-4b40-8d57-596f3071be6d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Deleting offline snapshot 598cd369-cf52-4b40-8d57-596f3071be6d of volume 2446d97e-65d2-4264-afe6-7e2d95fc9b4b {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] snapshot_file for this snap is: volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[df249954-5d09-4e84-a3d6-b192fe0a4bdb]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:05 devstack sudo[105287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d
Nov 02 10:22:05 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:06 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d" returned: 0 in 0.371s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:22:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa19387-d806-4358-a3a1-291b4500d93a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:06 devstack sudo[105292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b
Nov 02 10:22:06 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:06 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" returned: 0 in 0.537s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:06 devstack sudo[105297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d
Nov 02 10:22:06 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:06 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d" returned: 0 in 0.335s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:07 devstack sudo[105302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d
Nov 02 10:22:07 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:07 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b.598cd369-cf52-4b40-8d57-596f3071be6d" returned: 0 in 0.251s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-598cd369-cf52-4b40-8d57-596f3071be6d" released by "_delete_snapshot" :: held 1.614s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" released by "delete_snapshot" :: held 1.644s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:07 devstack sudo[105307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:07 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Created reservations ['b66d5bc0-a922-4ea6-8ab9-f6ae4c38bb67', '667d066e-f4c1-4430-b75f-de39f8155b1a', '36ca3e2a-ba6c-46f2-9fd8-bb8634e91611', 'd665365e-ca7b-4039-b8e4-7d821031d20f'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Delete snapshot completed successfully.
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d329a6b6-1286-475b-9043-56585c827cce tempest-TestStampPattern-1893337203 None] Lock "cinder-598cd369-cf52-4b40-8d57-596f3071be6d-delete_snapshot" released by "delete_snapshot" :: held 1.818s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:07 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.292s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:22:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:22:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-6419173b-4ea3-4dc5-a6db-cd1c7debe70f req-63bfe51c-8444-43de-b785-e81f050313d1 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-6419173b-4ea3-4dc5-a6db-cd1c7debe70f req-63bfe51c-8444-43de-b785-e81f050313d1 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-6419173b-4ea3-4dc5-a6db-cd1c7debe70f req-63bfe51c-8444-43de-b785-e81f050313d1 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-6419173b-4ea3-4dc5-a6db-cd1c7debe70f req-63bfe51c-8444-43de-b785-e81f050313d1 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-c5062514-82da-4833-b00b-07b160fdec61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c5bb872-0e1d-4d1c-84b5-ce9a1628979e', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:22:08 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-6419173b-4ea3-4dc5-a6db-cd1c7debe70f req-63bfe51c-8444-43de-b785-e81f050313d1 tempest-TestServerVolumeAttachmentScenario-1521245445 None] attachment_update completed successfully.
Nov 02 10:22:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Acquiring lock "cinder-2446d97e-65d2-4264-afe6-7e2d95fc9b4b-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Lock "cinder-2446d97e-65d2-4264-afe6-7e2d95fc9b4b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Acquiring lock "cinder-quobyte-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" acquired by "delete_volume" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:11 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[06993874-ceca-4f27-b2c0-6e45b9a060e9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:11 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b
Nov 02 10:22:11 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:12 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" returned: 0 in 0.381s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:12 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b
Nov 02 10:22:12 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:12 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" returned: 0 in 0.256s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Lock "cinder-quobyte-2446d97e-65d2-4264-afe6-7e2d95fc9b4b" released by "delete_volume" :: held 0.713s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Created reservations ['add98b80-2208-43da-9482-0ec558a05488', '38765211-7a11-44a6-975b-aa155c9c97ab', 'bbbb4218-068f-48a4-8e09-5e4bc91063cb', '8bc15f52-7f91-4056-bcd8-886d13a007d8'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:12 devstack sudo[105775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:12 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:12 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.310s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:12 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Deleted volume successfully.
Nov 02 10:22:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-586bb0b5-a254-4e6d-a9aa-6f31e6c73ebe tempest-TestStampPattern-1893337203 None] Lock "cinder-2446d97e-65d2-4264-afe6-7e2d95fc9b4b-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-45edde0e-3898-4144-acc4-e0678e8f364f req-cb427bbf-b97c-49a7-a734-6e944541bb18 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-45edde0e-3898-4144-acc4-e0678e8f364f req-cb427bbf-b97c-49a7-a734-6e944541bb18 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [req-45edde0e-3898-4144-acc4-e0678e8f364f req-cb427bbf-b97c-49a7-a734-6e944541bb18 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:13 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-45edde0e-3898-4144-acc4-e0678e8f364f req-cb427bbf-b97c-49a7-a734-6e944541bb18 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74', 'name': 'volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f5c7e0b-5202-4d59-8288-5efbce39cafc', 'enforce_multipath': True} {{(pid=87014) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 02 10:22:13 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-45edde0e-3898-4144-acc4-e0678e8f364f req-cb427bbf-b97c-49a7-a734-6e944541bb18 tempest-TestServerVolumeAttachmentScenario-1521245445 None] attachment_update completed successfully.
Nov 02 10:22:14 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-58cf1e65-7dd1-49cf-9699-5db01a5daf60 req-bd729fa7-2c4c-49bd-905f-2cc3429ddd17 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Terminate volume connection completed successfully.
Nov 02 10:22:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-58cf1e65-7dd1-49cf-9699-5db01a5daf60 req-bd729fa7-2c4c-49bd-905f-2cc3429ddd17 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Deleting attachment 0f5c7e0b-5202-4d59-8288-5efbce39cafc. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:22:16 devstack cinder-volume[87014]: INFO cinder.volume.manager [req-f911547d-ef9c-4f9c-9054-762567806fa3 req-7f939345-564e-413a-9c15-6111ca895239 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Terminate volume connection completed successfully.
Nov 02 10:22:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [req-f911547d-ef9c-4f9c-9054-762567806fa3 req-7f939345-564e-413a-9c15-6111ca895239 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Deleting attachment 0c5bb872-0e1d-4d1c-84b5-ce9a1628979e. {{(pid=87014) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 02 10:22:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "cinder-dd2a6ad0-12c9-4de8-8616-2629656ef95b-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "cinder-dd2a6ad0-12c9-4de8-8616-2629656ef95b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "cinder-quobyte-dd2a6ad0-12c9-4de8-8616-2629656ef95b" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "cinder-quobyte-dd2a6ad0-12c9-4de8-8616-2629656ef95b" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:21 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab067b6f-edbd-4def-ae0e-b82b1a47613b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:21 devstack sudo[105892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b
Nov 02 10:22:21 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:22 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b" returned: 0 in 0.391s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:22 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b
Nov 02 10:22:22 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:22 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-dd2a6ad0-12c9-4de8-8616-2629656ef95b" returned: 0 in 0.291s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "cinder-quobyte-dd2a6ad0-12c9-4de8-8616-2629656ef95b" released by "delete_volume" :: held 0.735s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Created reservations ['a7611fb5-af00-46b1-a369-fe377364922d', 'd40a7571-ab7e-45b0-b46c-e860182506d1', '07b2e9eb-6d01-4fbf-9c97-41c8135a8d05', 'e5f4746f-0559-443f-8795-93951174e7cc'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:22 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:22 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "cinder-c5062514-82da-4833-b00b-07b160fdec61-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "cinder-c5062514-82da-4833-b00b-07b160fdec61-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:22 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.288s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Deleted volume successfully.
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "cinder-quobyte-c5062514-82da-4833-b00b-07b160fdec61" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abead1a3-3aca-461d-8c76-618be536f6d5 tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "cinder-dd2a6ad0-12c9-4de8-8616-2629656ef95b-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "cinder-quobyte-c5062514-82da-4833-b00b-07b160fdec61" acquired by "delete_volume" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6575e627-0d21-4003-a309-4b352413f056]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:23 devstack sudo[105903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61
Nov 02 10:22:23 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:23 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61" returned: 0 in 0.396s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:23 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61
Nov 02 10:22:23 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:23 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c5062514-82da-4833-b00b-07b160fdec61" returned: 0 in 0.257s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "cinder-quobyte-c5062514-82da-4833-b00b-07b160fdec61" released by "delete_volume" :: held 0.702s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Created reservations ['a95de8df-eb61-419d-b6c7-81830d0b46b9', 'c996491c-e10a-49d6-b12d-92a6ed1a3de8', 'a520131e-5bf1-4313-aadf-55e1051994c0', '896223b2-ef45-462c-976b-b8f83441d651'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:23 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:23 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:23 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.274s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:23 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:24 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Deleted volume successfully.
Nov 02 10:22:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2661a949-0a12-496d-aed0-133fb0d6170b tempest-TestServerVolumeAttachmentScenario-1521245445 None] Lock "cinder-c5062514-82da-4833-b00b-07b160fdec61-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (603f4aa1-38db-4950-bc93-a715014204db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb7deea-8f6f-4756-83d9-4c0b5197d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb7deea-8f6f-4756-83d9-4c0b5197d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548991310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c10146-77a8-4bd5-9c03-6fc1ad40a295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:27Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c587989-a25a-43c3-9138-ebcc8a096f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c587989-a25a-43c3-9138-ebcc8a096f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1061f9-1d55-4d04-bb04-c7a8cf9730c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1061f9-1d55-4d04-bb04-c7a8cf9730c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c10146-77a8-4bd5-9c03-6fc1ad40a295', 'volume_name': 'volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1a7ffd-b392-4652-8e06-295e80cf7652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1a7ffd-b392-4652-8e06-295e80cf7652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2ef627-a72d-4fbd-9164-20f5dcce74f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:26 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume 85c10146-77a8-4bd5-9c03-6fc1ad40a295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295', 'volume_size': 1}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548991310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c10146-77a8-4bd5-9c03-6fc1ad40a295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:27Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Creating volume 85c10146-77a8-4bd5-9c03-6fc1ad40a295 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:22:26 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:22:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:27 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 1073741824
Nov 02 10:22:27 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:27 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 1073741824" returned: 0 in 0.463s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:27 devstack sudo[105924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295
Nov 02 10:22:27 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:27 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295" returned: 0 in 0.296s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:22:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2ef627-a72d-4fbd-9164-20f5dcce74f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca208fe-e0d2-4279-a0fe-c0dd4c484d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:27 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 (85c10146-77a8-4bd5-9c03-6fc1ad40a295): created successfully
Nov 02 10:22:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca208fe-e0d2-4279-a0fe-c0dd4c484d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (603f4aa1-38db-4950-bc93-a715014204db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:27 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-420f3b2e-4f73-4bee-ba15-c7da0b09d775 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created volume successfully.
Nov 02 10:22:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Creating offline snapshot 0a42c378-6268-4bcb-8205-ab76317f5c73 of volume 85c10146-77a8-4bd5-9c03-6fc1ad40a295 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:22:29 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f659cc2a-ce62-49ce-84c2-7e4d49b2ebf8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:29 devstack sudo[105929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295
Nov 02 10:22:29 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:29 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295" returned: 0 in 0.394s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:29 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73 1G
Nov 02 10:22:29 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:29 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73 1G" returned: 0 in 0.456s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:30 devstack sudo[105940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73
Nov 02 10:22:30 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:30 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73" returned: 0 in 0.327s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:30 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73 is being set with open permissions: ugo+rw
Nov 02 10:22:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:30 devstack sudo[105946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73
Nov 02 10:22:30 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:30 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73" returned: 0 in 0.299s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:30 devstack sudo[105949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.info
Nov 02 10:22:30 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:30 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.info" returned: 0 in 0.293s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:30 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.info is being set with open permissions: ugo+rw
Nov 02 10:22:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:30 devstack sudo[105952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.info
Nov 02 10:22:30 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:31 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.info" returned: 0 in 0.263s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:31 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4af94690-3a56-408f-b136-87564bc37772 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Create snapshot completed successfully
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (afced42a-e65d-4f6e-b04c-a1aaebeffbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77928ec-3ab6-4fee-84bb-ff30747e8046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77928ec-3ab6-4fee-84bb-ff30747e8046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1460544504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcaf062-95a4-4e62-9362-0d4028515ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:33Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778b2dfd-d613-4955-acc2-370bc6bbaac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778b2dfd-d613-4955-acc2-370bc6bbaac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f89ce2-2744-409b-a7c4-9a4e64e7c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f89ce2-2744-409b-a7c4-9a4e64e7c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcaf062-95a4-4e62-9362-0d4028515ca2', 'volume_name': 'volume-3fcaf062-95a4-4e62-9362-0d4028515ca2', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2e2610-8c51-42de-8ab1-3c23012636bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2e2610-8c51-42de-8ab1-3c23012636bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d4db46-8a26-4e33-88d5-d744c73dc65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:32 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume 3fcaf062-95a4-4e62-9362-0d4028515ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcaf062-95a4-4e62-9362-0d4028515ca2', 'volume_size': 1}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1460544504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcaf062-95a4-4e62-9362-0d4028515ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:33Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Creating volume 3fcaf062-95a4-4e62-9362-0d4028515ca2 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:22:32 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:22:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:33 devstack sudo[105955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2 1073741824
Nov 02 10:22:33 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (174e8a78-72f3-4822-a9ad-a4675c6b912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143e0210-13ba-4d42-a50e-2c5f3850160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143e0210-13ba-4d42-a50e-2c5f3850160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943899228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36041f47-aa8e-465b-89f1-50cfdf0ba5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:33Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91272343-849c-4c00-9805-f7a2cc7c7e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91272343-849c-4c00-9805-f7a2cc7c7e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9f1f4e-0018-40f4-a765-615502ab5de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9f1f4e-0018-40f4-a765-615502ab5de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36041f47-aa8e-465b-89f1-50cfdf0ba5e4', 'volume_name': 'volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b933d10-0558-4933-82a3-c119f0811757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b933d10-0558-4933-82a3-c119f0811757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73e297b-f4fc-4781-98c4-262ff2306877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:33 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume 36041f47-aa8e-465b-89f1-50cfdf0ba5e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4', 'volume_size': 1}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:33 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2 1073741824" returned: 0 in 0.629s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:33 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2
Nov 02 10:22:33 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (0bdbb339-4fdc-443d-a088-bed0eed8b072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7328f316-5cff-4e65-93f9-525475d93e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7328f316-5cff-4e65-93f9-525475d93e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312334758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b4d52c-b375-4638-a480-1be49d7599bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:34Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fcd867-f95c-44be-a027-5fbe92e8f07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fcd867-f95c-44be-a027-5fbe92e8f07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7e82a3-8345-4008-b7f3-44165128621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7e82a3-8345-4008-b7f3-44165128621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b4d52c-b375-4638-a480-1be49d7599bd', 'volume_name': 'volume-38b4d52c-b375-4638-a480-1be49d7599bd', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77f239a-6147-4792-a11d-08cf8bf091d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77f239a-6147-4792-a11d-08cf8bf091d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122b9085-3491-40c4-8300-3fd26ae39e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:34 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume 38b4d52c-b375-4638-a480-1be49d7599bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b4d52c-b375-4638-a480-1be49d7599bd', 'volume_size': 1}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:34 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2" returned: 0 in 0.393s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.691s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-943899228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36041f47-aa8e-465b-89f1-50cfdf0ba5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:33Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Creating volume 36041f47-aa8e-465b-89f1-50cfdf0ba5e4 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:22:34 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d4db46-8a26-4e33-88d5-d744c73dc65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcaf062-95a4-4e62-9362-0d4028515ca2', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:34 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4 1073741824
Nov 02 10:22:34 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c926966-930f-4310-b9ed-d32f3bade182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:34 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume volume-3fcaf062-95a4-4e62-9362-0d4028515ca2 (3fcaf062-95a4-4e62-9362-0d4028515ca2): created successfully
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c926966-930f-4310-b9ed-d32f3bade182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (afced42a-e65d-4f6e-b04c-a1aaebeffbd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:34 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ad9fcbb9-8624-40f3-9869-897b92ed5dbe tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created volume successfully.
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (669799ef-e517-451b-997b-6677d7c5b3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc8a8c3-5fae-44da-9677-a9e09f01e1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc8a8c3-5fae-44da-9677-a9e09f01e1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-169582370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68378339-fc97-404b-a274-19520b8fbe80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:34Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120692a7-093b-4bfb-97b9-1b4679436c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120692a7-093b-4bfb-97b9-1b4679436c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230fb265-6966-4c6e-a175-13645c8205e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230fb265-6966-4c6e-a175-13645c8205e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68378339-fc97-404b-a274-19520b8fbe80', 'volume_name': 'volume-68378339-fc97-404b-a274-19520b8fbe80', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2595a0-be9c-459f-8060-2a3690d3c4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2595a0-be9c-459f-8060-2a3690d3c4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996d9b62-cce4-43af-be22-13c1e28adf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:34 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume 68378339-fc97-404b-a274-19520b8fbe80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68378339-fc97-404b-a274-19520b8fbe80', 'volume_size': 1}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:34 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4 1073741824" returned: 0 in 0.724s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:34 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4
Nov 02 10:22:34 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (b8269c0b-42d6-42d4-bc65-ce4c89b44f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a24e5c-4ddc-4c41-a3c1-ae01719fbc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a24e5c-4ddc-4c41-a3c1-ae01719fbc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20964038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645a4107-94f7-4b7e-9ab3-6ecf3bfa735c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:35Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7823515-46fc-4de7-9a04-721a6662de54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7823515-46fc-4de7-9a04-721a6662de54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11617df8-8d58-4fdb-9dbb-984eab860a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11617df8-8d58-4fdb-9dbb-984eab860a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '645a4107-94f7-4b7e-9ab3-6ecf3bfa735c', 'volume_name': 'volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a391f32a-042c-45b5-8071-38116651cbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a391f32a-042c-45b5-8071-38116651cbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f958f78a-d2ab-40ba-905e-3842c5a77fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:35 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume 645a4107-94f7-4b7e-9ab3-6ecf3bfa735c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c', 'volume_size': 1}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:35 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4" returned: 0 in 0.341s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.168s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312334758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b4d52c-b375-4638-a480-1be49d7599bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:34Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Creating volume 38b4d52c-b375-4638-a480-1be49d7599bd {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:22:35 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73e297b-f4fc-4781-98c4-262ff2306877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c52f075-90c8-4f1d-852a-110a396fb15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:35 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd 1073741824
Nov 02 10:22:35 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:35 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4 (36041f47-aa8e-465b-89f1-50cfdf0ba5e4): created successfully
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c52f075-90c8-4f1d-852a-110a396fb15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (174e8a78-72f3-4822-a9ad-a4675c6b912d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:35 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-291f5a73-9ce0-42a3-8695-0c830233c209 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created volume successfully.
Nov 02 10:22:35 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd 1073741824" returned: 0 in 0.500s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:35 devstack sudo[105980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd
Nov 02 10:22:35 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:36 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd" returned: 0 in 0.269s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.571s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-169582370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68378339-fc97-404b-a274-19520b8fbe80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:34Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Creating volume 68378339-fc97-404b-a274-19520b8fbe80 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:22:36 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122b9085-3491-40c4-8300-3fd26ae39e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b4d52c-b375-4638-a480-1be49d7599bd', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:36 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80 1073741824
Nov 02 10:22:36 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b54380c-5c2e-45bb-aa66-8ce16b046dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:36 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume volume-38b4d52c-b375-4638-a480-1be49d7599bd (38b4d52c-b375-4638-a480-1be49d7599bd): created successfully
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b54380c-5c2e-45bb-aa66-8ce16b046dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (0bdbb339-4fdc-443d-a088-bed0eed8b072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c99326e0-d968-49f5-8ffb-d116b1e57d94 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created volume successfully.
Nov 02 10:22:36 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80 1073741824" returned: 0 in 0.526s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:36 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80
Nov 02 10:22:36 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:36 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80" returned: 0 in 0.300s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.817s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20964038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645a4107-94f7-4b7e-9ab3-6ecf3bfa735c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b379f42b454a0aa25d2e42e552f92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:35Z,use_quota=True,user_id='1192b0bf16604b2ebcfc6b8924aefaca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Creating volume 645a4107-94f7-4b7e-9ab3-6ecf3bfa735c {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:22:36 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996d9b62-cce4-43af-be22-13c1e28adf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68378339-fc97-404b-a274-19520b8fbe80', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546863b1-7943-4a2e-989c-2b2801f4e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:36 devstack sudo[105992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c 1073741824
Nov 02 10:22:36 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:36 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume volume-68378339-fc97-404b-a274-19520b8fbe80 (68378339-fc97-404b-a274-19520b8fbe80): created successfully
Nov 02 10:22:36 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546863b1-7943-4a2e-989c-2b2801f4e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (669799ef-e517-451b-997b-6677d7c5b3d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:37 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-221516fd-e9a7-4d68-b0ff-dc04f780f8a1 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created volume successfully.
Nov 02 10:22:37 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c 1073741824" returned: 0 in 0.503s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:37 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c
Nov 02 10:22:37 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:37 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c" returned: 0 in 0.299s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:22:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f958f78a-d2ab-40ba-905e-3842c5a77fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1b1b6b-02b5-43ff-898c-7bf22c33a4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:37 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Volume volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c (645a4107-94f7-4b7e-9ab3-6ecf3bfa735c): created successfully
Nov 02 10:22:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1b1b6b-02b5-43ff-898c-7bf22c33a4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Flow 'volume_create_manager' (b8269c0b-42d6-42d4-bc65-ce4c89b44f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:37 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-be3e5bf1-2539-4ced-87ab-0b3a767dcb3b tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created volume successfully.
Nov 02 10:22:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-quobyte-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:38 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c8a28d-2148-4ca3-9eaa-982a775e269b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:38 devstack sudo[106001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c
Nov 02 10:22:38 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:38 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c" returned: 0 in 0.392s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:39 devstack sudo[106007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c
Nov 02 10:22:39 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:39 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c" returned: 0 in 0.278s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c" released by "delete_volume" :: held 0.717s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created reservations ['1d1cfd10-7473-4628-be41-40ab6cb5f20b', '3a1ba4fb-689a-4fd6-b4aa-e88ead30e4dc', '3ec7ec5e-78ba-4511-b3e1-ae87ac60717b', 'c0094605-0fea-4417-a5d7-4c4eb0441dd9'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:39 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:39 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-68378339-fc97-404b-a274-19520b8fbe80-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-68378339-fc97-404b-a274-19520b8fbe80-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:39 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-quobyte-68378339-fc97-404b-a274-19520b8fbe80" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.321s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Deleted volume successfully.
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-68378339-fc97-404b-a274-19520b8fbe80" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7afe1b72-9023-4f3f-aff8-110b7acb3872 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-645a4107-94f7-4b7e-9ab3-6ecf3bfa735c-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb5f902-405d-4361-85df-e445866dd75d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:39 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80
Nov 02 10:22:39 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:40 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80" returned: 0 in 0.383s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:40 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80
Nov 02 10:22:40 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:40 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68378339-fc97-404b-a274-19520b8fbe80" returned: 0 in 0.317s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-68378339-fc97-404b-a274-19520b8fbe80" released by "delete_volume" :: held 0.756s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created reservations ['895cf1b6-6b01-444f-8692-dbe261a1609d', '09058ee2-3496-4826-9c0e-16c2e906e53d', '4e25961e-fcb0-47e1-a8ae-e99c757f9c10', '4364d61a-4424-427a-ae2b-8b07f77fb5d3'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:40 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:40 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-38b4d52c-b375-4638-a480-1be49d7599bd-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-38b4d52c-b375-4638-a480-1be49d7599bd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-quobyte-38b4d52c-b375-4638-a480-1be49d7599bd" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-38b4d52c-b375-4638-a480-1be49d7599bd" acquired by "delete_volume" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[130ea647-d935-41d1-8bda-7e8a1f487bfa]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:41 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.315s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Deleted volume successfully.
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-12344ac6-e60c-488e-93d9-35d98417bdc9 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-68378339-fc97-404b-a274-19520b8fbe80-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:41 devstack sudo[106025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd
Nov 02 10:22:41 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:41 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd" returned: 0 in 0.429s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:41 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd
Nov 02 10:22:41 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:41 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Flow 'volume_create_manager' (3a147fff-3816-4c8b-8325-73d07ade8580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9061fb55-336e-4944-bede-1634851b5aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-38b4d52c-b375-4638-a480-1be49d7599bd" returned: 0 in 0.329s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9061fb55-336e-4944-bede-1634851b5aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210f782c-003e-412c-a143-e77cc6de1e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9adb511dca4acd80c10f61adf380cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:42Z,use_quota=True,user_id='28b395528f674b78be16cc0a494b194a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a50df1bc-f5a3-4bb5-8686-927ff073d332),volume_type_id=a50df1bc-f5a3-4bb5-8686-927ff073d332)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31abbba6-d08a-40f1-af65-3c6adf086d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31abbba6-d08a-40f1-af65-3c6adf086d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368ae377-6cea-4efd-8cff-a9ef982407a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.image.glance [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Creating Keystone auth plugin from conf {{(pid=87014) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-38b4d52c-b375-4638-a480-1be49d7599bd" released by "delete_volume" :: held 0.844s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created reservations ['1267c59b-0088-4310-a6c7-fde2c9bd8929', '7da7e315-6207-486b-a1dd-c99fae3b9a75', 'b663d279-53d3-4b7e-af37-061b36898ae9', '30adbbe3-297e-4383-a859-b28353bf1207'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:42 devstack sudo[106033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:42 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-36041f47-aa8e-465b-89f1-50cfdf0ba5e4-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368ae377-6cea-4efd-8cff-a9ef982407a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '210f782c-003e-412c-a143-e77cc6de1e90', 'volume_name': 'volume-210f782c-003e-412c-a143-e77cc6de1e90', 'volume_size': 1, 'image_id': 'cb511941-ee8a-47e1-b0f2-02ba519f175b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb511941-ee8a-47e1-b0f2-02ba519f175b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9bc1f5f39b8890c3bbf415b095f37eea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9a9adb511dca4acd80c10f61adf380cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cae0fb6b25934bcf8af818ace160c6ee3b1e07ed06ddc4ce6cb3cfdf4d3283a9114dc19ff8c84c9e2eab86d6f5c7cfb337ccaac47559ff15033bf54ed6596345', 'id': 'cb511941-ee8a-47e1-b0f2-02ba519f175b', 'created_at': datetime.datetime(2026, 11, 2, 9, 22, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 22, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb511941-ee8a-47e1-b0f2-02ba519f175b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0409b0>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60eaa261-5e55-4539-a996-9fcf5f31b014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60eaa261-5e55-4539-a996-9fcf5f31b014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31245c3c-e2dc-4913-b754-8c02395e908a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:42 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Volume 210f782c-003e-412c-a143-e77cc6de1e90: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-210f782c-003e-412c-a143-e77cc6de1e90', 'volume_size': 1, 'image_id': 'cb511941-ee8a-47e1-b0f2-02ba519f175b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb511941-ee8a-47e1-b0f2-02ba519f175b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9bc1f5f39b8890c3bbf415b095f37eea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9a9adb511dca4acd80c10f61adf380cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cae0fb6b25934bcf8af818ace160c6ee3b1e07ed06ddc4ce6cb3cfdf4d3283a9114dc19ff8c84c9e2eab86d6f5c7cfb337ccaac47559ff15033bf54ed6596345', 'id': 'cb511941-ee8a-47e1-b0f2-02ba519f175b', 'created_at': datetime.datetime(2026, 11, 2, 9, 22, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 22, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb511941-ee8a-47e1-b0f2-02ba519f175b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0409b0>}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Trying to clone 210f782c-003e-412c-a143-e77cc6de1e90 from image cb511941-ee8a-47e1-b0f2-02ba519f175b at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb511941-ee8a-47e1-b0f2-02ba519f175b', 'metadata': {}}]). {{(pid=87014) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-36041f47-aa8e-465b-89f1-50cfdf0ba5e4-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-quobyte-36041f47-aa8e-465b-89f1-50cfdf0ba5e4" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-36041f47-aa8e-465b-89f1-50cfdf0ba5e4" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 02 10:22:42 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Image download 0.00 MB at 0.00 MB/s
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b01a42-417d-4b15-803c-f998cc4c07c7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:42 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.325s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:42 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Deleted volume successfully.
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6800322-49a9-4368-8c52-9ce6edfc5dbe]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec82400e-5bf3-40c9-b113-da7bb4be4a90 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-38b4d52c-b375-4638-a480-1be49d7599bd-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:42 devstack sudo[106036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4
Nov 02 10:22:42 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:42 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD
Nov 02 10:22:42 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:42 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:42 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4" returned: 0 in 0.463s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:42 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4
Nov 02 10:22:42 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:42 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD
Nov 02 10:22:42 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:43 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-36041f47-aa8e-465b-89f1-50cfdf0ba5e4" returned: 0 in 0.283s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-36041f47-aa8e-465b-89f1-50cfdf0ba5e4" released by "delete_volume" :: held 0.816s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:43 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Temporary image cb511941-ee8a-47e1-b0f2-02ba519f175b is fetched for user 28b395528f674b78be16cc0a494b194a. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created reservations ['8ff67e2f-7009-430a-bd5d-85b36f0f287f', '228b6776-9d3b-41b2-8516-18e5b3df5b31', '679decf1-9c16-4505-8269-d4b1094633e1', '51816eef-bcd6-45f0-983d-7d466f71733c'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff543a4-853e-4684-bffa-af9c035de4f4]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:43 devstack sudo[106054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:43 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-3fcaf062-95a4-4e62-9362-0d4028515ca2-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:43 devstack sudo[106053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD
Nov 02 10:22:43 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-3fcaf062-95a4-4e62-9362-0d4028515ca2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-quobyte-3fcaf062-95a4-4e62-9362-0d4028515ca2" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-3fcaf062-95a4-4e62-9362-0d4028515ca2" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb47e1fc-5700-4152-8011-a71c40d20171]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:43 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.341s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:43 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Deleted volume successfully.
Nov 02 10:22:43 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:43 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2
Nov 02 10:22:43 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-da2e585c-66d2-489f-88c6-8e3d1067a024 tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-36041f47-aa8e-465b-89f1-50cfdf0ba5e4-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:43 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD
Nov 02 10:22:43 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:43 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2" returned: 0 in 0.478s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:43 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210f782c-003e-412c-a143-e77cc6de1e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9adb511dca4acd80c10f61adf380cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:42Z,use_quota=True,user_id='28b395528f674b78be16cc0a494b194a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a50df1bc-f5a3-4bb5-8686-927ff073d332),volume_type_id=a50df1bc-f5a3-4bb5-8686-927ff073d332)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Creating volume 210f782c-003e-412c-a143-e77cc6de1e90 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:22:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:44 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:44 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:22:44 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:44 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90 1073741824
Nov 02 10:22:44 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:44 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3fcaf062-95a4-4e62-9362-0d4028515ca2" returned: 0 in 0.322s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-3fcaf062-95a4-4e62-9362-0d4028515ca2" released by "delete_volume" :: held 0.857s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created reservations ['540814f9-84c8-4ae6-b09a-73702d79b950', 'aa8faee6-0ebc-4902-9074-4f010f0b3eb5', '7e51374f-288e-4a30-b51e-9c59183e13e4', '3fa7b7a6-b87c-4159-999e-3d68eb49ea34'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:44 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:44 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-0a42c378-6268-4bcb-8205-ab76317f5c73-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-0a42c378-6268-4bcb-8205-ab76317f5c73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-quobyte-85c10146-77a8-4bd5-9c03-6fc1ad40a295" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-85c10146-77a8-4bd5-9c03-6fc1ad40a295" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-quobyte-0a42c378-6268-4bcb-8205-ab76317f5c73" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-0a42c378-6268-4bcb-8205-ab76317f5c73" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Deleting offline snapshot 0a42c378-6268-4bcb-8205-ab76317f5c73 of volume 85c10146-77a8-4bd5-9c03-6fc1ad40a295 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:22:44 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] snapshot_file for this snap is: volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90 1073741824" returned: 0 in 0.660s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b19ca4-9ea8-4129-a14f-5a6c23aeb292]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:44 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90
Nov 02 10:22:44 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:44 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.348s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Deleted volume successfully.
Nov 02 10:22:44 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73
Nov 02 10:22:44 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b70afe7a-ad27-43be-8eb7-401a20ceb88a tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-3fcaf062-95a4-4e62-9362-0d4028515ca2-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:45 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90" returned: 0 in 0.342s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Attempting download of cb511941-ee8a-47e1-b0f2-02ba519f175b ((None, [{'url': 'file:///opt/stack/data/glance/images/cb511941-ee8a-47e1-b0f2-02ba519f175b', 'metadata': {}}])) to volume 210f782c-003e-412c-a143-e77cc6de1e90. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[13220869-e87e-4a6c-bd13-ee47233910dd]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb511941-ee8a-47e1-b0f2-02ba519f175b_blggaomg {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:45 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73" returned: 0 in 0.557s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[53141860-98eb-4ed3-b2eb-b7f17b9f581d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:45 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb511941-ee8a-47e1-b0f2-02ba519f175b_blggaomg
Nov 02 10:22:45 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:45 devstack sudo[106091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295
Nov 02 10:22:45 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:45 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb511941-ee8a-47e1-b0f2-02ba519f175b_blggaomg" returned: 0 in 0.412s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb511941-ee8a-47e1-b0f2-02ba519f175b_blggaomg {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:45 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295" returned: 0 in 0.400s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:45 devstack sudo[106095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb511941-ee8a-47e1-b0f2-02ba519f175b_blggaomg
Nov 02 10:22:45 devstack sudo[106099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73
Nov 02 10:22:45 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:45 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:45 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb511941-ee8a-47e1-b0f2-02ba519f175b_blggaomg" returned: 1 in 0.402s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb511941-ee8a-47e1-b0f2-02ba519f175b_blggaomg' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea59e0f8-b0bd-4d56-97f4-4579e9ff73f4]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:46 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73" returned: 0 in 0.367s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:46 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73
Nov 02 10:22:46 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:46 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD
Nov 02 10:22:46 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:46 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295.0a42c378-6268-4bcb-8205-ab76317f5c73" returned: 0 in 0.247s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-0a42c378-6268-4bcb-8205-ab76317f5c73" released by "_delete_snapshot" :: held 1.719s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-85c10146-77a8-4bd5-9c03-6fc1ad40a295" released by "delete_snapshot" :: held 1.756s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:46 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created reservations ['fa8faa5e-5573-4969-a076-4b7e749c1fc7', '1818a616-c095-4e89-baba-2721f2addb23', '7e81dd9a-e6b8-431a-83e1-4a51bf512c24', 'f94a7011-1540-496e-b24f-31fb9908c2c2'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:46 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Delete snapshot completed successfully.
Nov 02 10:22:46 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD
Nov 02 10:22:46 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-918d037f-2c90-4140-957e-ebf8f789a53e tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-0a42c378-6268-4bcb-8205-ab76317f5c73-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-85c10146-77a8-4bd5-9c03-6fc1ad40a295-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-85c10146-77a8-4bd5-9c03-6fc1ad40a295-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:46 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] cb511941-ee8a-47e1-b0f2-02ba519f175b was raw, converting to qcow2 {{(pid=87014) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:46 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90
Nov 02 10:22:46 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "cinder-quobyte-85c10146-77a8-4bd5-9c03-6fc1ad40a295" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-85c10146-77a8-4bd5-9c03-6fc1ad40a295" acquired by "delete_volume" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc83d24d-cb5e-4271-aa28-bf249d30a3be]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:47 devstack sudo[106122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295
Nov 02 10:22:47 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:47 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90" returned: 0 in 0.482s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb511941-ee8a-47e1-b0f2-02ba519f175b_z341c7uidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:22:47 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Converted 0.00 MB image at 0.00 MB/s
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:47 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90 1G
Nov 02 10:22:47 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:47 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295" returned: 0 in 0.415s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:47 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295
Nov 02 10:22:47 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:47 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-85c10146-77a8-4bd5-9c03-6fc1ad40a295" returned: 0 in 0.265s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:47 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-quobyte-85c10146-77a8-4bd5-9c03-6fc1ad40a295" released by "delete_volume" :: held 0.766s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90 1G" returned: 0 in 0.350s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Downloaded image cb511941-ee8a-47e1-b0f2-02ba519f175b ((None, [{'url': 'file:///opt/stack/data/glance/images/cb511941-ee8a-47e1-b0f2-02ba519f175b', 'metadata': {}}])) to volume 210f782c-003e-412c-a143-e77cc6de1e90 successfully. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Temporary image cb511941-ee8a-47e1-b0f2-02ba519f175b for user 28b395528f674b78be16cc0a494b194a is deleted. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Marking volume 210f782c-003e-412c-a143-e77cc6de1e90 as bootable. {{(pid=87014) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Copying metadata from image cb511941-ee8a-47e1-b0f2-02ba519f175b to 210f782c-003e-412c-a143-e77cc6de1e90. {{(pid=87014) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Creating volume glance metadata for volume 210f782c-003e-412c-a143-e77cc6de1e90 backed by image cb511941-ee8a-47e1-b0f2-02ba519f175b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cb511941-ee8a-47e1-b0f2-02ba519f175b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9bc1f5f39b8890c3bbf415b095f37eea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87014) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Created reservations ['d6bfb891-400d-432c-8491-e3db08b4d7d6', '473c2fe5-5162-4f49-af9f-bf7ad444db1b', 'eeedbf0d-6155-4859-96a2-c70890bb7dbc', '222df997-f04d-4943-819e-ed37d513e654'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31245c3c-e2dc-4913-b754-8c02395e908a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-210f782c-003e-412c-a143-e77cc6de1e90', 'volume_size': 1, 'image_id': 'cb511941-ee8a-47e1-b0f2-02ba519f175b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb511941-ee8a-47e1-b0f2-02ba519f175b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9bc1f5f39b8890c3bbf415b095f37eea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9a9adb511dca4acd80c10f61adf380cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cae0fb6b25934bcf8af818ace160c6ee3b1e07ed06ddc4ce6cb3cfdf4d3283a9114dc19ff8c84c9e2eab86d6f5c7cfb337ccaac47559ff15033bf54ed6596345', 'id': 'cb511941-ee8a-47e1-b0f2-02ba519f175b', 'created_at': datetime.datetime(2026, 11, 2, 9, 22, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 22, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb511941-ee8a-47e1-b0f2-02ba519f175b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f0409b0>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437294d3-17a3-4490-9583-16bf8edbe54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:47 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Volume volume-210f782c-003e-412c-a143-e77cc6de1e90 (210f782c-003e-412c-a143-e77cc6de1e90): created successfully
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437294d3-17a3-4490-9583-16bf8edbe54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Flow 'volume_create_manager' (3a147fff-3816-4c8b-8325-73d07ade8580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-a0b5f06d-dd07-47fd-ab63-958437a91873 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Created volume successfully.
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:47 devstack sudo[106138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:47 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:48 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.308s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Deleted volume successfully.
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-68b58623-bd52-47a0-a7c6-f4e0a6461fff tempest-CreateVolumesFromSnapshotTest-1612037906 None] Lock "cinder-85c10146-77a8-4bd5-9c03-6fc1ad40a295-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Acquiring lock "cinder-210f782c-003e-412c-a143-e77cc6de1e90-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Lock "cinder-210f782c-003e-412c-a143-e77cc6de1e90-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=115,cinder:UPDATE=115,cinder:INSERT=30,cinder:DELETE=14 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=100,cinder:UPDATE=125,cinder:INSERT=36,cinder:DELETE=4 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Acquiring lock "cinder-quobyte-210f782c-003e-412c-a143-e77cc6de1e90" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Lock "cinder-quobyte-210f782c-003e-412c-a143-e77cc6de1e90" acquired by "delete_volume" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e8e703-f140-44e7-8d5d-a9b54181126d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:48 devstack sudo[106141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90
Nov 02 10:22:48 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:48 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90" returned: 0 in 0.425s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:48 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90
Nov 02 10:22:48 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:49 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-210f782c-003e-412c-a143-e77cc6de1e90" returned: 0 in 0.286s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Lock "cinder-quobyte-210f782c-003e-412c-a143-e77cc6de1e90" released by "delete_volume" :: held 0.761s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:49 devstack cinder-volume[87014]: WARNING cinder.quota [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:22:49 devstack cinder-volume[87014]: WARNING cinder.quota [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Created reservations ['61e092d1-32a4-490e-ae2c-b56d5a033e88', '943bb4df-0470-4ee0-8113-266c60a18cdf', '34083b0f-b152-467c-82a8-19f82d432f20', '21e08c29-ded1-4011-ab37-c461fb6f2016'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:49 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:22:49 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:49 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.313s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:22:49 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Deleted volume successfully.
Nov 02 10:22:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8e243014-57d2-4bbb-9890-f4dc8aa8eaa2 tempest-VolumeAndVolumeTypeFromImageTest-1404133240 None] Lock "cinder-210f782c-003e-412c-a143-e77cc6de1e90-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Flow 'volume_create_manager' (271f5651-6158-41c8-bf33-7591ca88b2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176eede3-93b2-4853-8807-3c29a300bfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176eede3-93b2-4853-8807-3c29a300bfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1895153274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2faae3-4754-42f4-9e5b-b52e399a1b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670c93d242154d47949794605c35629f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:51Z,use_quota=True,user_id='3e45f437d0784c4b9572c3ec937ae996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd57e92-96b2-472c-80e5-4b4297abade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd57e92-96b2-472c-80e5-4b4297abade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fec4809-57ff-4886-82f2-3aca3e232761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fec4809-57ff-4886-82f2-3aca3e232761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2faae3-4754-42f4-9e5b-b52e399a1b0f', 'volume_name': 'volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63396397-8bbb-4091-9b79-4b64580ac0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63396397-8bbb-4091-9b79-4b64580ac0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88d8892-05fe-4527-af93-d41a7ea64612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:51 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Volume 3a2faae3-4754-42f4-9e5b-b52e399a1b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f', 'volume_size': 1}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1895153274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2faae3-4754-42f4-9e5b-b52e399a1b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670c93d242154d47949794605c35629f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:51Z,use_quota=True,user_id='3e45f437d0784c4b9572c3ec937ae996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Creating volume 3a2faae3-4754-42f4-9e5b-b52e399a1b0f {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:22:51 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:22:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:51 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f 1073741824
Nov 02 10:22:51 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:52 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f 1073741824" returned: 0 in 0.500s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:52 devstack sudo[106159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f
Nov 02 10:22:52 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:52 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" returned: 0 in 0.264s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:22:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88d8892-05fe-4527-af93-d41a7ea64612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9f2f5f-7d7c-437c-b92d-d946c9ad0753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:52 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Volume volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f (3a2faae3-4754-42f4-9e5b-b52e399a1b0f): created successfully
Nov 02 10:22:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9f2f5f-7d7c-437c-b92d-d946c9ad0753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Flow 'volume_create_manager' (271f5651-6158-41c8-bf33-7591ca88b2ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-09e1c43e-2ab0-4066-89da-0420c21c9708 tempest-VolumeDependencyTests-824696 None] Created volume successfully.
Nov 02 10:22:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] Creating offline snapshot f6e91ed0-f027-497e-807e-0382fef5b5cf of volume 3a2faae3-4754-42f4-9e5b-b52e399a1b0f {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:22:53 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[11208df5-8174-4a80-9c8c-51c35ff6090f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:54 devstack sudo[106162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f
Nov 02 10:22:54 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:54 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" returned: 0 in 0.412s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:54 devstack sudo[106167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf 1G
Nov 02 10:22:54 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (54312197-8fd7-4d5d-8b0e-dc4e80c2e4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4657c6-553a-4720-be68-53e8185d848b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce4657c6-553a-4720-be68-53e8185d848b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-796638277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18071116-b300-4b8b-ac24-1c5f2e3460bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:54Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35bf7b2-6f29-4255-9152-91ceeffb2754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35bf7b2-6f29-4255-9152-91ceeffb2754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7fabc5-8fc0-474e-a28a-bde951a9b308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7fabc5-8fc0-474e-a28a-bde951a9b308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18071116-b300-4b8b-ac24-1c5f2e3460bf', 'volume_name': 'volume-18071116-b300-4b8b-ac24-1c5f2e3460bf', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a038d74-2b40-45ec-be62-6331c8b1fc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a038d74-2b40-45ec-be62-6331c8b1fc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defae924-799a-486a-814d-58ec7b31e5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:54 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume 18071116-b300-4b8b-ac24-1c5f2e3460bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18071116-b300-4b8b-ac24-1c5f2e3460bf', 'volume_size': 1}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:54 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf 1G" returned: 0 in 0.391s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:54 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf
Nov 02 10:22:54 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:55 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf" returned: 0 in 0.298s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:55 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf is being set with open permissions: ugo+rw
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:55 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf
Nov 02 10:22:55 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:55 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf" returned: 0 in 0.242s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:55 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.info
Nov 02 10:22:55 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:55 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.info" returned: 0 in 0.276s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:55 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.info is being set with open permissions: ugo+rw
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:55 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.info
Nov 02 10:22:55 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:55 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.info" returned: 0 in 0.243s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-796638277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18071116-b300-4b8b-ac24-1c5f2e3460bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:54Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Creating volume 18071116-b300-4b8b-ac24-1c5f2e3460bf {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:22:55 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:22:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:55 devstack sudo[106186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf 1073741824
Nov 02 10:22:55 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:55 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c07d44c0-d0eb-4f0b-b058-f143b873fe51 tempest-VolumeDependencyTests-824696 None] Create snapshot completed successfully
Nov 02 10:22:56 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf 1073741824" returned: 0 in 0.473s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:56 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf
Nov 02 10:22:56 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Flow 'volume_create_manager' (451eea74-0c84-4cf1-baaf-b682b4e29bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c6737a-9dc7-42f9-98ba-c0043baaec14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c6737a-9dc7-42f9-98ba-c0043baaec14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1216539213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122b499a-c7cb-40d8-9ad7-8a21b7771be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670c93d242154d47949794605c35629f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f6e91ed0-f027-497e-807e-0382fef5b5cf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:57Z,use_quota=True,user_id='3e45f437d0784c4b9572c3ec937ae996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef67a316-050a-4f1e-829f-3a6d3f20e515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef67a316-050a-4f1e-829f-3a6d3f20e515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748f899d-97eb-4361-ad26-0e9e2df69fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748f899d-97eb-4361-ad26-0e9e2df69fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '122b499a-c7cb-40d8-9ad7-8a21b7771be1', 'volume_name': 'volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1', 'volume_size': 1, 'snapshot_id': 'f6e91ed0-f027-497e-807e-0382fef5b5cf'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7be852-f24c-48c4-bd28-ca0edae8b243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7be852-f24c-48c4-bd28-ca0edae8b243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58a0b68-592f-4693-9949-71ccb58e93ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:56 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Volume 122b499a-c7cb-40d8-9ad7-8a21b7771be1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1', 'volume_size': 1, 'snapshot_id': 'f6e91ed0-f027-497e-807e-0382fef5b5cf'}
Nov 02 10:22:56 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf" returned: 0 in 0.306s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Acquiring lock "cinder-quobyte-f6e91ed0-f027-497e-807e-0382fef5b5cf-122b499a-c7cb-40d8-9ad7-8a21b7771be1" by "_create_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defae924-799a-486a-814d-58ec7b31e5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18071116-b300-4b8b-ac24-1c5f2e3460bf', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d40450a-5864-4486-9438-a0ec80edbc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-f6e91ed0-f027-497e-807e-0382fef5b5cf-122b499a-c7cb-40d8-9ad7-8a21b7771be1" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Creating volume 122b499a-c7cb-40d8-9ad7-8a21b7771be1 from snapshot f6e91ed0-f027-497e-807e-0382fef5b5cf {{(pid=87014) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Acquiring lock "cinder-quobyte-122b499a-c7cb-40d8-9ad7-8a21b7771be1" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-122b499a-c7cb-40d8-9ad7-8a21b7771be1" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] snapshot: f6e91ed0-f027-497e-807e-0382fef5b5cf, volume: 122b499a-c7cb-40d8-9ad7-8a21b7771be1,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:22:56 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume volume-18071116-b300-4b8b-ac24-1c5f2e3460bf (18071116-b300-4b8b-ac24-1c5f2e3460bf): created successfully
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d40450a-5864-4486-9438-a0ec80edbc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (54312197-8fd7-4d5d-8b0e-dc4e80c2e4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:56 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-a6fed9a9-5c19-4164-a8b1-360c197e2878 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created volume successfully.
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8d6e29-f6f7-4a17-b798-009cb754f530]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:56 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf
Nov 02 10:22:56 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:57 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf" returned: 0 in 0.370s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:22:57 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdd4e8d-bf34-4b6d-9b4f-04cb4bc6218b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:22:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:57 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f
Nov 02 10:22:57 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:57 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Nov 02 10:22:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" returned: 0 in 0.382s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:22:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:22:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:22:57 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1 not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:22:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:22:57 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1
Nov 02 10:22:57 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (53be6557-0bd0-4ac3-917f-0d42eee57dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba767d11-de2e-4bde-b8af-bde6c76d1f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba767d11-de2e-4bde-b8af-bde6c76d1f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1569636821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a9e4dd-9404-4fb1-9d61-96549734bab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:58Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd500a6-28e5-4efa-bf67-f44180c3b54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd500a6-28e5-4efa-bf67-f44180c3b54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b83782-468b-44bc-9885-8c723efb5b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b83782-468b-44bc-9885-8c723efb5b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a9e4dd-9404-4fb1-9d61-96549734bab0', 'volume_name': 'volume-03a9e4dd-9404-4fb1-9d61-96549734bab0', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f779a3-dc66-4be6-bea4-b40bc8da5634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f779a3-dc66-4be6-bea4-b40bc8da5634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a19bd9-3fe6-40ec-829e-cee67c74a799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:58 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume 03a9e4dd-9404-4fb1-9d61-96549734bab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a9e4dd-9404-4fb1-9d61-96549734bab0', 'volume_size': 1}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (9509a2a4-2708-42df-af29-516be1f7d1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41814e46-129e-489e-b6ec-f43963bf517f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41814e46-129e-489e-b6ec-f43963bf517f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-634438826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209b2190-a598-4610-b6f6-9e854821df81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:59Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b3d302-6fcd-4e3f-9b0f-10ad6d72e70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b3d302-6fcd-4e3f-9b0f-10ad6d72e70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f86bd5-24c7-4614-be4b-8566c0758822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f86bd5-24c7-4614-be4b-8566c0758822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209b2190-a598-4610-b6f6-9e854821df81', 'volume_name': 'volume-209b2190-a598-4610-b6f6-9e854821df81', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4686134e-574d-48e9-a61d-6511fe7c476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4686134e-574d-48e9-a61d-6511fe7c476b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee2fe46-91b3-426a-ac5e-6558c6f67245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:58 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume 209b2190-a598-4610-b6f6-9e854821df81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209b2190-a598-4610-b6f6-9e854821df81', 'volume_size': 1}
Nov 02 10:22:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (ee3baf7a-c6ed-408d-a5be-cd955b3d0f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90ceedd-45c7-4bc3-bbdd-2265d8e4b9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a90ceedd-45c7-4bc3-bbdd-2265d8e4b9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386816275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8749d3ec-2230-4e8b-91f4-0c1f8f4a984a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:59Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b75e70f-1ac2-4baf-bb35-8c536ca30af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b75e70f-1ac2-4baf-bb35-8c536ca30af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0e1656-eb83-4195-b4e8-6e8ba88f1b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0e1656-eb83-4195-b4e8-6e8ba88f1b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8749d3ec-2230-4e8b-91f4-0c1f8f4a984a', 'volume_name': 'volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0bd0fb-e47c-48fe-9eb0-6cbbe1372802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0bd0fb-e47c-48fe-9eb0-6cbbe1372802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817a40ad-1a46-4099-ae20-5b4072627a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:22:59 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume 8749d3ec-2230-4e8b-91f4-0c1f8f4a984a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a', 'volume_size': 1}
Nov 02 10:22:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (a843236a-ed98-4db1-aaf0-c62b552f6fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e4e6d8-0488-4c32-a79a-ab1bf132ce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e4e6d8-0488-4c32-a79a-ab1bf132ce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085404463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a589fa4-c567-42b6-9259-162032663468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:00Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03f67d6-c942-4ecb-b920-2b39bd07dbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03f67d6-c942-4ecb-b920-2b39bd07dbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8d1453-c6eb-4bfc-94b5-bd29424265b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8d1453-c6eb-4bfc-94b5-bd29424265b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a589fa4-c567-42b6-9259-162032663468', 'volume_name': 'volume-3a589fa4-c567-42b6-9259-162032663468', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd12d8a-5ea1-4232-b35b-87811a797927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd12d8a-5ea1-4232-b35b-87811a797927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594df563-2781-487a-a03b-da22724feb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:00 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume 3a589fa4-c567-42b6-9259-162032663468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a589fa4-c567-42b6-9259-162032663468', 'volume_size': 1}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (4994cb75-a559-4da3-8262-43a5fba94653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e913ae1b-bab3-4dab-813d-2259b16b272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e913ae1b-bab3-4dab-813d-2259b16b272e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1070415714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d64ce5-e009-417e-bf53-75e69c7fa350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:01Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6aed31-d5fe-4b0f-940c-3300c11d614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6aed31-d5fe-4b0f-940c-3300c11d614e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b6e20e-ec7d-40b4-ada3-228138df2733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b6e20e-ec7d-40b4-ada3-228138df2733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d64ce5-e009-417e-bf53-75e69c7fa350', 'volume_name': 'volume-10d64ce5-e009-417e-bf53-75e69c7fa350', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f646b629-5ef7-4bb6-926b-3289dbc4e54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f646b629-5ef7-4bb6-926b-3289dbc4e54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86921f30-4c0c-414c-a3a3-58ef04826e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:00 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume 10d64ce5-e009-417e-bf53-75e69c7fa350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d64ce5-e009-417e-bf53-75e69c7fa350', 'volume_size': 1}
Nov 02 10:23:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:04 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1" returned: 0 in 6.633s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:23:04 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Converted 1024.00 MB image at 154.35 MB/s
Nov 02 10:23:04 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1 is being set with open permissions: ugo+rw
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:04 devstack sudo[106226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1
Nov 02 10:23:04 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:04 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1" returned: 0 in 0.235s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-122b499a-c7cb-40d8-9ad7-8a21b7771be1" released by "_copy_volume_from_snapshot" :: held 7.741s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-f6e91ed0-f027-497e-807e-0382fef5b5cf-122b499a-c7cb-40d8-9ad7-8a21b7771be1" released by "_create_volume_from_snapshot" :: held 7.811s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.841s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.327s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1569636821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a9e4dd-9404-4fb1-9d61-96549734bab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:58Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Creating volume 03a9e4dd-9404-4fb1-9d61-96549734bab0 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:04 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:04 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0 1073741824
Nov 02 10:23:04 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58a0b68-592f-4693-9949-71ccb58e93ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1', 'volume_size': 1, 'snapshot_id': 'f6e91ed0-f027-497e-807e-0382fef5b5cf'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48248536-37db-4dbe-addf-0fd67aa4c60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:04 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Volume volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1 (122b499a-c7cb-40d8-9ad7-8a21b7771be1): created successfully
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48248536-37db-4dbe-addf-0fd67aa4c60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Flow 'volume_create_manager' (451eea74-0c84-4cf1-baaf-b682b4e29bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:04 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e975b4b2-555e-4ba9-bc96-9a4fe5a45771 tempest-VolumeDependencyTests-824696 None] Created volume successfully.
Nov 02 10:23:04 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0 1073741824" returned: 0 in 0.413s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:05 devstack sudo[106237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0
Nov 02 10:23:05 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:05 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0" returned: 0 in 0.229s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.325s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-634438826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209b2190-a598-4610-b6f6-9e854821df81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:59Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Creating volume 209b2190-a598-4610-b6f6-9e854821df81 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:05 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a19bd9-3fe6-40ec-829e-cee67c74a799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a9e4dd-9404-4fb1-9d61-96549734bab0', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ac415e-21cb-4162-9529-09fcba3d5752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:05 devstack sudo[106240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81 1073741824
Nov 02 10:23:05 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:05 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume volume-03a9e4dd-9404-4fb1-9d61-96549734bab0 (03a9e4dd-9404-4fb1-9d61-96549734bab0): created successfully
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ac415e-21cb-4162-9529-09fcba3d5752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (53be6557-0bd0-4ac3-917f-0d42eee57dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:05 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f09e4295-4f9b-457e-96f3-5b7fa293815c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created volume successfully.
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Acquiring lock "cinder-f6e91ed0-f027-497e-807e-0382fef5b5cf-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Lock "cinder-f6e91ed0-f027-497e-807e-0382fef5b5cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Acquiring lock "cinder-quobyte-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Acquiring lock "cinder-quobyte-f6e91ed0-f027-497e-807e-0382fef5b5cf" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-f6e91ed0-f027-497e-807e-0382fef5b5cf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Deleting offline snapshot f6e91ed0-f027-497e-807e-0382fef5b5cf of volume 3a2faae3-4754-42f4-9e5b-b52e399a1b0f {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] snapshot_file for this snap is: volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bb97ef-32e6-4aea-a180-e28b96da1eb0]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:05 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf
Nov 02 10:23:05 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:05 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81 1073741824" returned: 0 in 0.455s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:05 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81
Nov 02 10:23:05 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:05 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf" returned: 0 in 0.363s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c807c0db-c428-4fad-ac66-cde3e029e303]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:05 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f
Nov 02 10:23:05 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:05 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81" returned: 0 in 0.241s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.380s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386816275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8749d3ec-2230-4e8b-91f4-0c1f8f4a984a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:22:59Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Creating volume 8749d3ec-2230-4e8b-91f4-0c1f8f4a984a {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:05 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee2fe46-91b3-426a-ac5e-6558c6f67245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209b2190-a598-4610-b6f6-9e854821df81', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:06 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a 1073741824
Nov 02 10:23:06 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ee8a77-fe6b-48a0-aef6-ecffeb77c93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:06 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume volume-209b2190-a598-4610-b6f6-9e854821df81 (209b2190-a598-4610-b6f6-9e854821df81): created successfully
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ee8a77-fe6b-48a0-aef6-ecffeb77c93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (9509a2a4-2708-42df-af29-516be1f7d1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:06 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ccde5b4e-baf5-4aef-a9c6-2236ac2cb7f0 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created volume successfully.
Nov 02 10:23:06 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" returned: 0 in 0.548s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:06 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a 1073741824" returned: 0 in 0.424s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:06 devstack sudo[106264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf
Nov 02 10:23:06 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:06 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a
Nov 02 10:23:06 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:06 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a" returned: 0 in 0.260s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.260s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085404463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a589fa4-c567-42b6-9259-162032663468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:00Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Creating volume 3a589fa4-c567-42b6-9259-162032663468 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:06 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:06 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf" returned: 0 in 0.344s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:06 devstack sudo[106272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468 1073741824
Nov 02 10:23:06 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:06 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf
Nov 02 10:23:06 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817a40ad-1a46-4099-ae20-5b4072627a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8b16ee-d5c4-4db2-a63a-06d655803390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:06 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a (8749d3ec-2230-4e8b-91f4-0c1f8f4a984a): created successfully
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8b16ee-d5c4-4db2-a63a-06d655803390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (ee3baf7a-c6ed-408d-a5be-cd955b3d0f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:06 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-7e9a9bb6-018e-4afc-8264-89d0b33d72da tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created volume successfully.
Nov 02 10:23:06 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f.f6e91ed0-f027-497e-807e-0382fef5b5cf" returned: 0 in 0.250s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-f6e91ed0-f027-497e-807e-0382fef5b5cf" released by "_delete_snapshot" :: held 1.608s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" released by "delete_snapshot" :: held 1.631s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Created reservations ['6132e2a4-8804-462e-ae06-4e8827375eaa', '65c3e059-7f8b-4d8d-9900-84a9a2e64e11', 'e61c8025-95fc-4879-a4a4-77b87b4ac61a', '373ae9b0-663b-4249-88a1-456eeb100b40'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Delete snapshot completed successfully.
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eb0b4892-ab48-4175-bbb8-c7d341e08117 tempest-VolumeDependencyTests-824696 None] Lock "cinder-f6e91ed0-f027-497e-807e-0382fef5b5cf-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:07 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468 1073741824" returned: 0 in 0.456s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:07 devstack sudo[106281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468
Nov 02 10:23:07 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:07 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:07 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:07 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468" returned: 0 in 0.244s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.632s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1070415714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d64ce5-e009-417e-bf53-75e69c7fa350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612eed1b4b7747c6804af383c0e03ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:01Z,use_quota=True,user_id='3248b35413e6408fa233ef6703ceabaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Creating volume 10d64ce5-e009-417e-bf53-75e69c7fa350 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:07 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594df563-2781-487a-a03b-da22724feb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a589fa4-c567-42b6-9259-162032663468', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:07 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350 1073741824
Nov 02 10:23:07 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c967bd-53a9-4ba9-9059-df608a10f431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:07 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume volume-3a589fa4-c567-42b6-9259-162032663468 (3a589fa4-c567-42b6-9259-162032663468): created successfully
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c967bd-53a9-4ba9-9059-df608a10f431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (a843236a-ed98-4db1-aaf0-c62b552f6fd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Acquiring lock "cinder-3a2faae3-4754-42f4-9e5b-b52e399a1b0f-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:07 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.292s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-279f50c2-da70-4dd6-9e93-ab1627dbbb33 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created volume successfully.
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Lock "cinder-3a2faae3-4754-42f4-9e5b-b52e399a1b0f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Acquiring lock "cinder-quobyte-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" acquired by "delete_volume" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cb7f2f-f6ae-4134-90eb-236463326dd5]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:07 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f
Nov 02 10:23:07 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:07 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350 1073741824" returned: 0 in 0.477s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:08 devstack sudo[106295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350
Nov 02 10:23:08 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:08 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" returned: 0 in 0.389s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:08 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f
Nov 02 10:23:08 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:08 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350" returned: 0 in 0.250s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86921f30-4c0c-414c-a3a3-58ef04826e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d64ce5-e009-417e-bf53-75e69c7fa350', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd156cd4-b0af-4299-b0c1-5f2305b2ec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:08 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Volume volume-10d64ce5-e009-417e-bf53-75e69c7fa350 (10d64ce5-e009-417e-bf53-75e69c7fa350): created successfully
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd156cd4-b0af-4299-b0c1-5f2305b2ec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Flow 'volume_create_manager' (4994cb75-a559-4da3-8262-43a5fba94653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:08 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d65f3916-7b7e-4fa4-8123-cfc04e5cb9cc tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created volume successfully.
Nov 02 10:23:08 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" returned: 0 in 0.248s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-3a2faae3-4754-42f4-9e5b-b52e399a1b0f" released by "delete_volume" :: held 0.698s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Created reservations ['b42db487-a24f-4d17-9344-90f06da58dea', '00d16d9d-026e-4506-8c91-b28c9c16bac5', '8a557362-9a90-40e0-9fe1-c490a826edbf', '423ee544-695b-4f86-b4b4-c6ac97480520'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:08 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:08 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-10d64ce5-e009-417e-bf53-75e69c7fa350-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-10d64ce5-e009-417e-bf53-75e69c7fa350-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-quobyte-10d64ce5-e009-417e-bf53-75e69c7fa350" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-10d64ce5-e009-417e-bf53-75e69c7fa350" acquired by "delete_volume" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e881e7ee-9c4e-49cf-907c-f1f5dc44c162]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:08 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.271s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Acquiring lock "cinder-122b499a-c7cb-40d8-9ad7-8a21b7771be1-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:08 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Deleted volume successfully.
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Lock "cinder-122b499a-c7cb-40d8-9ad7-8a21b7771be1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-314c068f-e806-4116-8056-0f343e26ea54 tempest-VolumeDependencyTests-824696 None] Lock "cinder-3a2faae3-4754-42f4-9e5b-b52e399a1b0f-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:08 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350
Nov 02 10:23:08 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Acquiring lock "cinder-quobyte-122b499a-c7cb-40d8-9ad7-8a21b7771be1" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-122b499a-c7cb-40d8-9ad7-8a21b7771be1" acquired by "delete_volume" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ec6964-903e-48f9-a1ca-7638e5dd8339]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:08 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1
Nov 02 10:23:08 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:09 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350" returned: 0 in 0.406s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:09 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350
Nov 02 10:23:09 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:09 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1" returned: 0 in 0.360s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:09 devstack sudo[106320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1
Nov 02 10:23:09 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:09 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-10d64ce5-e009-417e-bf53-75e69c7fa350" returned: 0 in 0.254s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-10d64ce5-e009-417e-bf53-75e69c7fa350" released by "delete_volume" :: held 0.715s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created reservations ['527938a0-9f92-4dcd-86f8-67ed35189d77', 'a5fcd22f-f607-4721-95a9-355304041e2b', 'e37994f7-3972-4cb1-994a-77c144f89134', 'c3309fa7-b065-4ef0-875b-c175fe3f0c7e'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:09 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-122b499a-c7cb-40d8-9ad7-8a21b7771be1" returned: 0 in 0.262s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:09 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Lock "cinder-quobyte-122b499a-c7cb-40d8-9ad7-8a21b7771be1" released by "delete_volume" :: held 0.665s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:09 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Created reservations ['4f645bf4-007c-4b2c-af9e-4ec2f2b131cf', '82326e15-ffe9-45e2-99fb-971651332998', '5df09bb2-ee23-4bcb-a0aa-5ac16235c406', 'c48b2fa1-47c7-4cf5-a72c-984d560d55ab'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:09 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:09 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-3a589fa4-c567-42b6-9259-162032663468-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:09 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.284s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-3a589fa4-c567-42b6-9259-162032663468-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Deleted volume successfully.
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e30e0187-c117-4e73-9152-d39ee4c0ec0f tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-10d64ce5-e009-417e-bf53-75e69c7fa350-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-quobyte-3a589fa4-c567-42b6-9259-162032663468" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-3a589fa4-c567-42b6-9259-162032663468" acquired by "delete_volume" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2c21bb-363d-40d4-b203-b4ccfb5ff1c2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:09 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.314s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Deleted volume successfully.
Nov 02 10:23:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-08f6715e-9de3-40c9-907e-6a57d3bc764f tempest-VolumeDependencyTests-824696 None] Lock "cinder-122b499a-c7cb-40d8-9ad7-8a21b7771be1-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:10 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468
Nov 02 10:23:10 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:10 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468" returned: 0 in 0.417s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:10 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468
Nov 02 10:23:10 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:10 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3a589fa4-c567-42b6-9259-162032663468" returned: 0 in 0.254s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-3a589fa4-c567-42b6-9259-162032663468" released by "delete_volume" :: held 0.738s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created reservations ['713f96e1-6af6-468e-b0fa-3f9730cca1ec', 'f2459de1-07a5-426b-8996-45b382ee157c', '0daaf80d-537c-4fdb-82dd-ada2e8d6db84', '241f92a4-be57-42a7-8e8a-99e797657f73'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:10 devstack sudo[106338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:10 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:10 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.265s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:10 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Deleted volume successfully.
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-quobyte-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6d6e4498-26f1-4207-88cd-089346e8d36c tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-3a589fa4-c567-42b6-9259-162032663468-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a" acquired by "delete_volume" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2427f3-c27d-463b-821f-15a1ac6579f7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:11 devstack sudo[106341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a
Nov 02 10:23:11 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:11 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a" returned: 0 in 0.398s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:11 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a
Nov 02 10:23:11 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:11 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a" returned: 0 in 0.274s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a" released by "delete_volume" :: held 0.713s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created reservations ['e21ae770-283a-4dbf-9b85-f331bd3948a1', '1eedba41-f99b-4408-96d4-07636e763daa', 'b2719ee1-eb47-4f62-9d48-c21126463b36', 'cd5db9ad-7f49-48ef-8b70-cc21184f1ca5'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:11 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:11 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-209b2190-a598-4610-b6f6-9e854821df81-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-209b2190-a598-4610-b6f6-9e854821df81-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:12 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.271s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:12 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Deleted volume successfully.
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-quobyte-209b2190-a598-4610-b6f6-9e854821df81" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-998dc5ea-dd4e-4957-91e4-9a8b7178a1ae tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-8749d3ec-2230-4e8b-91f4-0c1f8f4a984a-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-209b2190-a598-4610-b6f6-9e854821df81" acquired by "delete_volume" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feb57f4-578d-412f-be89-401586144b39]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:12 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81
Nov 02 10:23:12 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:12 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81" returned: 0 in 0.354s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:12 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81
Nov 02 10:23:12 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:12 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-209b2190-a598-4610-b6f6-9e854821df81" returned: 0 in 0.260s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-209b2190-a598-4610-b6f6-9e854821df81" released by "delete_volume" :: held 0.655s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created reservations ['67d9099d-b9c2-4eed-bf68-6b0c624e1f78', 'eec9f654-b127-407a-90cb-c69c427019aa', 'd8cee6a5-5ce4-4c7e-8ba0-a87c7db87352', '2c5e31ba-460e-4e9d-8287-488faa7d91a0'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:13 devstack sudo[106360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:13 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:13 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.241s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:13 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Deleted volume successfully.
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-65c64446-5971-4d12-a73f-7deb6ad07f3b tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-209b2190-a598-4610-b6f6-9e854821df81-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-03a9e4dd-9404-4fb1-9d61-96549734bab0-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-03a9e4dd-9404-4fb1-9d61-96549734bab0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-quobyte-03a9e4dd-9404-4fb1-9d61-96549734bab0" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-03a9e4dd-9404-4fb1-9d61-96549734bab0" acquired by "delete_volume" :: waited 0.013s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee263b-204f-4685-860c-eb7b666b36a3]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:13 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0
Nov 02 10:23:13 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:13 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0" returned: 0 in 0.344s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:13 devstack sudo[106368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0
Nov 02 10:23:13 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:13 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03a9e4dd-9404-4fb1-9d61-96549734bab0" returned: 0 in 0.238s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-03a9e4dd-9404-4fb1-9d61-96549734bab0" released by "delete_volume" :: held 0.620s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created reservations ['e1599e91-9577-4dcd-86b6-d3b023c6b87b', '042a634c-089f-445a-ae7a-4bc64bca514d', '4ca733be-6934-486b-ba3b-815bdf3a50dd', '75ca0fdb-d491-4c16-8f53-9421998c4960'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:14 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:14 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:14 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.236s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:14 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Deleted volume successfully.
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-face665f-6fde-470a-87cb-dc66929bdc47 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-03a9e4dd-9404-4fb1-9d61-96549734bab0-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-18071116-b300-4b8b-ac24-1c5f2e3460bf-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-18071116-b300-4b8b-ac24-1c5f2e3460bf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "cinder-quobyte-18071116-b300-4b8b-ac24-1c5f2e3460bf" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-18071116-b300-4b8b-ac24-1c5f2e3460bf" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3823bfdd-194b-4bb4-9b52-fb06702e8e0d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:14 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf
Nov 02 10:23:14 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:14 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf" returned: 0 in 0.355s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:14 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf
Nov 02 10:23:14 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:15 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18071116-b300-4b8b-ac24-1c5f2e3460bf" returned: 0 in 0.247s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-quobyte-18071116-b300-4b8b-ac24-1c5f2e3460bf" released by "delete_volume" :: held 0.662s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Created reservations ['743cfdf8-9f0a-46ab-8132-cceb63dd2372', 'cb077928-c2f7-4dfb-b792-72e0f283aaca', 'f3fb139b-9683-43c1-973a-f30ee5f26730', '1bca033b-770e-447d-b702-27392a906ca6'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:15 devstack sudo[106384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:15 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:15 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.270s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Deleted volume successfully.
Nov 02 10:23:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9658ba5a-166e-46a3-b45b-8529159befa3 tempest-CreateVolumesFromSourceVolumeTest-378372028 None] Lock "cinder-18071116-b300-4b8b-ac24-1c5f2e3460bf-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Flow 'volume_create_manager' (0a3e5427-378d-4cc3-b769-d693a00bd6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f04101-09a4-4481-a66b-5473d8b79e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f04101-09a4-4481-a66b-5473d8b79e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215735a045d640ac9a63ec72c4a80170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:18Z,use_quota=True,user_id='0b9df8848c0f402bbe0e4b73578138fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02424e4d-015f-4cfb-a2f5-9e6046c03be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02424e4d-015f-4cfb-a2f5-9e6046c03be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8bc5a9-4fad-4538-a429-e74d3e204cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8bc5a9-4fad-4538-a429-e74d3e204cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2', 'volume_name': 'volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69757c6d-fd05-49f2-b44f-c2bb980a0ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69757c6d-fd05-49f2-b44f-c2bb980a0ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4be349f-986f-4189-a654-4caf89188e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:18 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Volume 9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2', 'volume_size': 1}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215735a045d640ac9a63ec72c4a80170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:18Z,use_quota=True,user_id='0b9df8848c0f402bbe0e4b73578138fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Creating volume 9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:18 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:18 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2 1073741824
Nov 02 10:23:18 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:18 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2 1073741824" returned: 0 in 0.434s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:19 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2
Nov 02 10:23:19 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:19 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2" returned: 0 in 0.239s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4be349f-986f-4189-a654-4caf89188e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9895c37-b1fb-4e06-af76-aef3e56edb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:19 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Volume volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2 (9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2): created successfully
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9895c37-b1fb-4e06-af76-aef3e56edb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Flow 'volume_create_manager' (0a3e5427-378d-4cc3-b769-d693a00bd6c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-79c491ae-a77a-45ee-a545-b35ac882dcdf tempest-CinderUnicodeTest-2043319030 None] Created volume successfully.
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Flow 'volume_create_manager' (15ca10ee-a293-4032-aaf8-f5d403cd6ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0a5efc-151f-48f4-a004-ff1dce096901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0a5efc-151f-48f4-a004-ff1dce096901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2086643142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf2e63d-479a-4816-9626-47f74a4fd8da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215735a045d640ac9a63ec72c4a80170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:20Z,use_quota=True,user_id='0b9df8848c0f402bbe0e4b73578138fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7caa9a89-df68-4e18-a17b-90d6a469da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7caa9a89-df68-4e18-a17b-90d6a469da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d91f12-d079-479e-8b3f-7f90736dda87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d91f12-d079-479e-8b3f-7f90736dda87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf2e63d-479a-4816-9626-47f74a4fd8da', 'volume_name': 'volume-edf2e63d-479a-4816-9626-47f74a4fd8da', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bc3662-ea51-4d9d-849c-eab76cb6d76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31bc3662-ea51-4d9d-849c-eab76cb6d76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7206614d-24ab-4ab5-80fb-7eaa6daab5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:20 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Volume edf2e63d-479a-4816-9626-47f74a4fd8da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf2e63d-479a-4816-9626-47f74a4fd8da', 'volume_size': 1}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2086643142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf2e63d-479a-4816-9626-47f74a4fd8da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215735a045d640ac9a63ec72c4a80170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:20Z,use_quota=True,user_id='0b9df8848c0f402bbe0e4b73578138fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Creating volume edf2e63d-479a-4816-9626-47f74a4fd8da {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:20 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:20 devstack sudo[106397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da 1073741824
Nov 02 10:23:20 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:20 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da 1073741824" returned: 0 in 0.421s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:20 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da
Nov 02 10:23:20 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:20 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da" returned: 0 in 0.243s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7206614d-24ab-4ab5-80fb-7eaa6daab5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf2e63d-479a-4816-9626-47f74a4fd8da', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3353b6a-4d91-4e1a-be51-09d0db53d13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:20 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Volume volume-edf2e63d-479a-4816-9626-47f74a4fd8da (edf2e63d-479a-4816-9626-47f74a4fd8da): created successfully
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3353b6a-4d91-4e1a-be51-09d0db53d13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Flow 'volume_create_manager' (15ca10ee-a293-4032-aaf8-f5d403cd6ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:20 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-cbae170c-a046-45b8-bdab-cc602180febb tempest-CinderUnicodeTest-2043319030 None] Created volume successfully.
Nov 02 10:23:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] Creating offline snapshot 96a4e55a-1b27-4c82-a69a-91f482f19fa6 of volume edf2e63d-479a-4816-9626-47f74a4fd8da {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:23:21 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[994fc070-9726-4b29-ad81-80e55b905685]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:21 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da
Nov 02 10:23:21 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:21 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da" returned: 0 in 0.363s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:21 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6 1G
Nov 02 10:23:21 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:21 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6 1G" returned: 0 in 0.400s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edf2e63d-479a-4816-9626-47f74a4fd8da -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:22 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edf2e63d-479a-4816-9626-47f74a4fd8da -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6
Nov 02 10:23:22 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:22 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edf2e63d-479a-4816-9626-47f74a4fd8da -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6" returned: 0 in 0.302s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:22 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6 is being set with open permissions: ugo+rw
Nov 02 10:23:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:22 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6
Nov 02 10:23:22 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:22 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6" returned: 0 in 0.243s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:22 devstack sudo[106461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.info
Nov 02 10:23:22 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:22 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.info" returned: 0 in 0.244s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:22 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.info is being set with open permissions: ugo+rw
Nov 02 10:23:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:22 devstack sudo[106464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.info
Nov 02 10:23:22 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:23 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.info" returned: 0 in 0.267s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:23 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2ab9d6cf-7b36-49e7-af33-95a4cc94e485 tempest-CinderUnicodeTest-2043319030 None] Create snapshot completed successfully
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "cinder-96a4e55a-1b27-4c82-a69a-91f482f19fa6-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-96a4e55a-1b27-4c82-a69a-91f482f19fa6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "cinder-quobyte-edf2e63d-479a-4816-9626-47f74a4fd8da" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-quobyte-edf2e63d-479a-4816-9626-47f74a4fd8da" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "cinder-quobyte-96a4e55a-1b27-4c82-a69a-91f482f19fa6" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-quobyte-96a4e55a-1b27-4c82-a69a-91f482f19fa6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Deleting offline snapshot 96a4e55a-1b27-4c82-a69a-91f482f19fa6 of volume edf2e63d-479a-4816-9626-47f74a4fd8da {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] snapshot_file for this snap is: volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[244af73c-75b7-4292-90d6-515e9a0e6cbb]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:23 devstack sudo[106467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6
Nov 02 10:23:23 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:23 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6" returned: 0 in 0.367s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edf2e63d-479a-4816-9626-47f74a4fd8da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab645e2-a073-401f-a35a-ea11ddb6982a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:23 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da
Nov 02 10:23:23 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:24 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da" returned: 0 in 0.358s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:24 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6
Nov 02 10:23:24 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:24 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6" returned: 0 in 0.327s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:24 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6
Nov 02 10:23:24 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:24 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da.96a4e55a-1b27-4c82-a69a-91f482f19fa6" returned: 0 in 0.246s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-quobyte-96a4e55a-1b27-4c82-a69a-91f482f19fa6" released by "_delete_snapshot" :: held 1.407s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-quobyte-edf2e63d-479a-4816-9626-47f74a4fd8da" released by "delete_snapshot" :: held 1.428s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:24 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Created reservations ['434471e4-a043-4f37-92ca-c9c8d237b0e9', '3ab83cbe-5647-4e50-9a61-fbafa5a43a33', '8ad893bf-2f0a-42c1-be7a-228492121cc3', 'b19d1ee2-9d5a-4ae6-8d3b-cd581be37aa5'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:24 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Delete snapshot completed successfully.
Nov 02 10:23:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-041535da-6785-4ef7-9a3a-c2eda1ec7a82 tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-96a4e55a-1b27-4c82-a69a-91f482f19fa6-delete_snapshot" released by "delete_snapshot" :: held 1.562s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "cinder-edf2e63d-479a-4816-9626-47f74a4fd8da-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-edf2e63d-479a-4816-9626-47f74a4fd8da-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "cinder-quobyte-edf2e63d-479a-4816-9626-47f74a4fd8da" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-quobyte-edf2e63d-479a-4816-9626-47f74a4fd8da" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:25 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b3ec48-3362-475f-94c5-c614220c5617]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:25 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da
Nov 02 10:23:25 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:25 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da" returned: 0 in 0.350s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:25 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da
Nov 02 10:23:25 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:26 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-edf2e63d-479a-4816-9626-47f74a4fd8da" returned: 0 in 0.232s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-quobyte-edf2e63d-479a-4816-9626-47f74a4fd8da" released by "delete_volume" :: held 0.645s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Created reservations ['03b2142b-7056-4bbe-90bb-72c8d5d5aad6', '0f75315d-e3f2-4177-ba0a-845a38abe3cc', 'ffb74f21-8436-4e6f-abcd-2da07b5dac14', 'fe3e1c22-4676-4272-9995-45ca631b7eea'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:26 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:26 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:26 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.247s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:26 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Deleted volume successfully.
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-595061b8-0e10-4aeb-a52e-425f1dc1780d tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-edf2e63d-479a-4816-9626-47f74a4fd8da-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "cinder-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "cinder-quobyte-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-quobyte-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2" acquired by "delete_volume" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f254f298-e7c7-42ae-afa9-111e2a97dbf2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:26 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2
Nov 02 10:23:26 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:27 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2" returned: 0 in 0.353s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:27 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2
Nov 02 10:23:27 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:27 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2" returned: 0 in 0.245s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-quobyte-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2" released by "delete_volume" :: held 0.641s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Created reservations ['3be7e062-0bb8-4b37-bfee-b7880647ee4d', 'cf32a771-40e7-4ee5-9d3b-475d3b3ce7b0', '832fa45e-6a96-421a-aaff-8635f52e1b87', '489e54e7-4b88-4e72-a6b8-e686e994f2b4'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:27 devstack sudo[106505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:27 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:27 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.269s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:27 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Deleted volume successfully.
Nov 02 10:23:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-35efc67e-0abb-424f-b22f-c048258f9a3a tempest-CinderUnicodeTest-2043319030 None] Lock "cinder-9acde0a1-1ca9-45ef-a4b8-fddbfbcd2fd2-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Flow 'volume_create_manager' (aeb20682-6fba-4329-8301-56922fa87637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7efd69-aeac-48e1-a819-4ca19a9528d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7efd69-aeac-48e1-a819-4ca19a9528d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798800555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ef0e99-c33c-4afb-91cc-a1d80242abca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b518226c3cfa4a5cad88aa95b30697c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:31Z,use_quota=True,user_id='3869af42a2f6436c85c417e90afe49cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca35840c-cc74-43f8-996e-ed062e6c4206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca35840c-cc74-43f8-996e-ed062e6c4206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4534969-0e3c-40bb-ad2d-b090a0410b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4534969-0e3c-40bb-ad2d-b090a0410b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ef0e99-c33c-4afb-91cc-a1d80242abca', 'volume_name': 'volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbbdd340-6a10-443a-ae9d-52023d7fb47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbbdd340-6a10-443a-ae9d-52023d7fb47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5c3121-fdca-4a80-bb4a-8d0e7ba80778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:31 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Volume d1ef0e99-c33c-4afb-91cc-a1d80242abca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca', 'volume_size': 1}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798800555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ef0e99-c33c-4afb-91cc-a1d80242abca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b518226c3cfa4a5cad88aa95b30697c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:31Z,use_quota=True,user_id='3869af42a2f6436c85c417e90afe49cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Creating volume d1ef0e99-c33c-4afb-91cc-a1d80242abca {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:31 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:31 devstack sudo[106509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca 1073741824
Nov 02 10:23:31 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:31 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca 1073741824" returned: 0 in 0.444s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:31 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca
Nov 02 10:23:31 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:32 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca" returned: 0 in 0.260s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5c3121-fdca-4a80-bb4a-8d0e7ba80778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb4e00b-9651-4f30-851f-e4ab6847898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:32 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Volume volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca (d1ef0e99-c33c-4afb-91cc-a1d80242abca): created successfully
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb4e00b-9651-4f30-851f-e4ab6847898c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Flow 'volume_create_manager' (aeb20682-6fba-4329-8301-56922fa87637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:32 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-afd1f490-ff74-49fe-b2f6-2ed3c58e46a7 tempest-ProjectReaderTests-1479621483 None] Created volume successfully.
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Acquiring lock "cinder-d1ef0e99-c33c-4afb-91cc-a1d80242abca-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Lock "cinder-d1ef0e99-c33c-4afb-91cc-a1d80242abca-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Acquiring lock "cinder-quobyte-d1ef0e99-c33c-4afb-91cc-a1d80242abca" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Lock "cinder-quobyte-d1ef0e99-c33c-4afb-91cc-a1d80242abca" acquired by "delete_volume" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd66630-5505-4fbb-ae15-cd45000218d7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:32 devstack sudo[106518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca
Nov 02 10:23:32 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:32 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca" returned: 0 in 0.368s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:32 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca
Nov 02 10:23:32 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:33 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1ef0e99-c33c-4afb-91cc-a1d80242abca" returned: 0 in 0.254s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Lock "cinder-quobyte-d1ef0e99-c33c-4afb-91cc-a1d80242abca" released by "delete_volume" :: held 0.663s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Created reservations ['d23aa01a-3e8d-4066-a9de-0b2c18616483', '48d09d15-6d3e-46d2-9f4b-41b5aac30d14', 'a8816a22-ef18-4f8f-b138-fadd800b847a', 'ee82abfa-9daf-492e-a813-30ba9b79f13c'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:33 devstack sudo[106526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:33 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:33 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.253s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:33 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Deleted volume successfully.
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-81bd75f9-879c-4375-9f4f-e6736b7336ff tempest-ProjectReaderTests-1479621483 None] Lock "cinder-d1ef0e99-c33c-4afb-91cc-a1d80242abca-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Flow 'volume_create_manager' (d4a8ae1c-83cb-4081-bb21-ed957de117c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697dd576-a2fb-42dc-9161-3a649815192f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697dd576-a2fb-42dc-9161-3a649815192f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1314973042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92e8396-4707-424d-9803-7cfd8d76cc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b518226c3cfa4a5cad88aa95b30697c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:34Z,use_quota=True,user_id='3869af42a2f6436c85c417e90afe49cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23f00ab-d983-46b7-b7ea-17f3dbfccdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23f00ab-d983-46b7-b7ea-17f3dbfccdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8fd41f-724b-445f-a92c-ffde0d22979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8fd41f-724b-445f-a92c-ffde0d22979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e92e8396-4707-424d-9803-7cfd8d76cc06', 'volume_name': 'volume-e92e8396-4707-424d-9803-7cfd8d76cc06', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bd268c-60f5-4219-9adf-699be6c1c9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bd268c-60f5-4219-9adf-699be6c1c9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1879707-244e-44f0-8c37-e8155b20bd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:34 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Volume e92e8396-4707-424d-9803-7cfd8d76cc06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e92e8396-4707-424d-9803-7cfd8d76cc06', 'volume_size': 1}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1314973042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92e8396-4707-424d-9803-7cfd8d76cc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b518226c3cfa4a5cad88aa95b30697c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:34Z,use_quota=True,user_id='3869af42a2f6436c85c417e90afe49cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Creating volume e92e8396-4707-424d-9803-7cfd8d76cc06 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:34 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:34 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06 1073741824
Nov 02 10:23:34 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:34 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06 1073741824" returned: 0 in 0.408s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:34 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06
Nov 02 10:23:34 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:34 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06" returned: 0 in 0.255s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1879707-244e-44f0-8c37-e8155b20bd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92e8396-4707-424d-9803-7cfd8d76cc06', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec340a3-2123-4f3e-9b39-49787541692c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:34 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Volume volume-e92e8396-4707-424d-9803-7cfd8d76cc06 (e92e8396-4707-424d-9803-7cfd8d76cc06): created successfully
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec340a3-2123-4f3e-9b39-49787541692c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:34 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Flow 'volume_create_manager' (d4a8ae1c-83cb-4081-bb21-ed957de117c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:34 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-15f6374e-57e7-4889-9184-0481d3cd84e8 tempest-ProjectReaderTests-1479621483 None] Created volume successfully.
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Acquiring lock "cinder-e92e8396-4707-424d-9803-7cfd8d76cc06-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Lock "cinder-e92e8396-4707-424d-9803-7cfd8d76cc06-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Acquiring lock "cinder-quobyte-e92e8396-4707-424d-9803-7cfd8d76cc06" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Lock "cinder-quobyte-e92e8396-4707-424d-9803-7cfd8d76cc06" acquired by "delete_volume" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b056d22c-90ca-4f4c-bec9-1ddcd67d2709]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:35 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06
Nov 02 10:23:35 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:35 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06" returned: 0 in 0.355s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:35 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06
Nov 02 10:23:35 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:35 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e92e8396-4707-424d-9803-7cfd8d76cc06" returned: 0 in 0.243s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Lock "cinder-quobyte-e92e8396-4707-424d-9803-7cfd8d76cc06" released by "delete_volume" :: held 0.638s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Created reservations ['7f9c7dcd-78cd-470c-b14d-4f073e2ac7dd', '00c377e9-a8fe-4161-a5c3-ef7609284692', 'bd451a84-75b8-4fd4-b530-2ac0d66b0127', '829d841a-9bb1-4a02-aef6-cdffedb8b6d6'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:35 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:23:35 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:36 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.248s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:36 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:23:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Deleted volume successfully.
Nov 02 10:23:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-cf6e9e8f-1354-45d4-9a96-482218ea7736 tempest-ProjectReaderTests-1479621483 None] Lock "cinder-e92e8396-4707-424d-9803-7cfd8d76cc06-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:23:45 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=114,cinder:INSERT=35,cinder:UPDATE=160,cinder:DELETE=9 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:23:46 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=103,cinder:INSERT=39,cinder:UPDATE=148,cinder:DELETE=18 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Flow 'volume_create_manager' (adf54ea2-2c61-4af2-b41c-4dc2e89111b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946ebc98-2a7c-4dae-9023-aa05581120f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946ebc98-2a7c-4dae-9023-aa05581120f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84d106d-ed6e-424b-9d64-7db84f6ea3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e093e24d81ed47c6ba1ae95f94005426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:53Z,use_quota=True,user_id='4349c8f31482452ca52157f740e90c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64851dc-6818-4891-862a-02306394c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64851dc-6818-4891-862a-02306394c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205c5dce-f8c7-4dd8-b133-2a5951f1540f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205c5dce-f8c7-4dd8-b133-2a5951f1540f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84d106d-ed6e-424b-9d64-7db84f6ea3af', 'volume_name': 'volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf01abb-3aef-43d1-a13e-f1a8a4d364c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf01abb-3aef-43d1-a13e-f1a8a4d364c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f0cbe3-4d23-4bdd-ba04-209f4b68cb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:53 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Volume e84d106d-ed6e-424b-9d64-7db84f6ea3af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af', 'volume_size': 1}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84d106d-ed6e-424b-9d64-7db84f6ea3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e093e24d81ed47c6ba1ae95f94005426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:53Z,use_quota=True,user_id='4349c8f31482452ca52157f740e90c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Creating volume e84d106d-ed6e-424b-9d64-7db84f6ea3af {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:53 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:53 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af 1073741824
Nov 02 10:23:53 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Flow 'volume_create_manager' (a7edc160-ade6-4b4c-a1e3-e8bdb43f7256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7960263d-6636-453c-9147-d1d566406b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7960263d-6636-453c-9147-d1d566406b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748656754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0352f0e-5bf4-4e4d-acd2-36b2fcf24180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0b44fe3ddc64ee0901d915bab98016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:54Z,use_quota=True,user_id='a380c11d5e884ba7995f97061aab0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d11a994-4d9a-418b-9382-3bb702f684b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d11a994-4d9a-418b-9382-3bb702f684b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f039436-0a99-4855-8858-dd3c8d7a4bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f039436-0a99-4855-8858-dd3c8d7a4bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0352f0e-5bf4-4e4d-acd2-36b2fcf24180', 'volume_name': 'volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf71e6d-9f07-4c1f-b792-01555808f854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf71e6d-9f07-4c1f-b792-01555808f854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ceb75c6-31d9-4f31-b276-b7c0ede4dce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:53 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Volume f0352f0e-5bf4-4e4d-acd2-36b2fcf24180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180', 'volume_size': 1}
Nov 02 10:23:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:54 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af 1073741824" returned: 0 in 0.692s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Flow 'volume_create_manager' (96e50985-7972-43e2-8b6d-c82a21772f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e95ebf3-6417-431c-9520-9702bfcc1cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e95ebf3-6417-431c-9520-9702bfcc1cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-432900567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac484de-62fc-4343-89c0-e1c27c080f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0b44fe3ddc64ee0901d915bab98016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:54Z,use_quota=True,user_id='a380c11d5e884ba7995f97061aab0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095493cc-2516-47d2-b818-bebaf3b97946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095493cc-2516-47d2-b818-bebaf3b97946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c107d4-aa77-4dc9-8cad-a500e413cb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c107d4-aa77-4dc9-8cad-a500e413cb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac484de-62fc-4343-89c0-e1c27c080f95', 'volume_name': 'volume-0ac484de-62fc-4343-89c0-e1c27c080f95', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff36e498-d814-4b38-b915-e782c6b0de97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff36e498-d814-4b38-b915-e782c6b0de97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c057bb-c3a2-4ca0-9993-4e09919e27bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:54 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Volume 0ac484de-62fc-4343-89c0-e1c27c080f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac484de-62fc-4343-89c0-e1c27c080f95', 'volume_size': 1}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:54 devstack sudo[106593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af
Nov 02 10:23:54 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:54 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af" returned: 0 in 0.427s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.073s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748656754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0352f0e-5bf4-4e4d-acd2-36b2fcf24180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0b44fe3ddc64ee0901d915bab98016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:54Z,use_quota=True,user_id='a380c11d5e884ba7995f97061aab0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Creating volume f0352f0e-5bf4-4e4d-acd2-36b2fcf24180 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:54 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:54 devstack sudo[106596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180 1073741824
Nov 02 10:23:54 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Flow 'volume_create_manager' (8178768d-b0c4-4661-8564-e17dcc476f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca944ad5-79a6-444a-936b-f1a1b599c20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca944ad5-79a6-444a-936b-f1a1b599c20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1039993319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18340779-b35a-4865-8543-c627b18dd08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0b44fe3ddc64ee0901d915bab98016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:55Z,use_quota=True,user_id='a380c11d5e884ba7995f97061aab0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1d7981-846a-44aa-af61-e137872cdc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1d7981-846a-44aa-af61-e137872cdc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a3bc77-b98e-41a0-ac74-66b9419dace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a3bc77-b98e-41a0-ac74-66b9419dace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18340779-b35a-4865-8543-c627b18dd08a', 'volume_name': 'volume-18340779-b35a-4865-8543-c627b18dd08a', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029812a1-9d5e-47d0-a42e-65b7ef2d0037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029812a1-9d5e-47d0-a42e-65b7ef2d0037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a273e2e7-20a0-404c-a458-d30f2f5cccd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:55 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Volume 18340779-b35a-4865-8543-c627b18dd08a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18340779-b35a-4865-8543-c627b18dd08a', 'volume_size': 1}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f0cbe3-4d23-4bdd-ba04-209f4b68cb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1dafa0-5836-4efd-abee-d653abf408d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:55 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Volume volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af (e84d106d-ed6e-424b-9d64-7db84f6ea3af): created successfully
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1dafa0-5836-4efd-abee-d653abf408d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Flow 'volume_create_manager' (adf54ea2-2c61-4af2-b41c-4dc2e89111b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:55 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-c07dd4ba-e833-40c2-aa70-0c3388502fe3 tempest-CinderUnicodeTest-947653795 None] Created volume successfully.
Nov 02 10:23:55 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180 1073741824" returned: 0 in 0.807s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:55 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180
Nov 02 10:23:55 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Flow 'volume_create_manager' (d76f2faf-557b-42d3-a930-14583de43d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33113288-d9e7-4581-9540-cf331bb87c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33113288-d9e7-4581-9540-cf331bb87c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-116514547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853013f8-0c3d-4f79-8c78-ba9bd9f03f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0b44fe3ddc64ee0901d915bab98016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:56Z,use_quota=True,user_id='a380c11d5e884ba7995f97061aab0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5917fa20-4568-4740-a549-a0da6d3cd8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5917fa20-4568-4740-a549-a0da6d3cd8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef104af9-0d73-43a9-bd99-e990aa2618a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef104af9-0d73-43a9-bd99-e990aa2618a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853013f8-0c3d-4f79-8c78-ba9bd9f03f6a', 'volume_name': 'volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad3cdc2-786e-4e0f-bcec-946e71bf2ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad3cdc2-786e-4e0f-bcec-946e71bf2ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c33286-5db3-4888-999a-97f2c244da34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:55 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Volume 853013f8-0c3d-4f79-8c78-ba9bd9f03f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a', 'volume_size': 1}
Nov 02 10:23:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:56 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180" returned: 0 in 0.389s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.756s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-432900567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac484de-62fc-4343-89c0-e1c27c080f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0b44fe3ddc64ee0901d915bab98016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:54Z,use_quota=True,user_id='a380c11d5e884ba7995f97061aab0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Creating volume 0ac484de-62fc-4343-89c0-e1c27c080f95 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:56 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ceb75c6-31d9-4f31-b276-b7c0ede4dce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c369ff-372c-4a40-b45a-cecc1d489006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:56 devstack sudo[106604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95 1073741824
Nov 02 10:23:56 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Flow 'volume_create_manager' (e196cd6f-7259-420a-ba0a-bfba8778652f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa84ed48-699a-4f75-b106-ec9556d56e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa84ed48-699a-4f75-b106-ec9556d56e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1148803430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16751569-a2b0-42db-942d-0fc73be21583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0b44fe3ddc64ee0901d915bab98016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:56Z,use_quota=True,user_id='a380c11d5e884ba7995f97061aab0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ec29b2-74b7-4a5b-828b-109c0c36f4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ec29b2-74b7-4a5b-828b-109c0c36f4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acbb1167-ba7b-4a85-b82d-5635ce43c8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acbb1167-ba7b-4a85-b82d-5635ce43c8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16751569-a2b0-42db-942d-0fc73be21583', 'volume_name': 'volume-16751569-a2b0-42db-942d-0fc73be21583', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576db6be-c7cf-4b9b-8744-7c0ac1e7b998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576db6be-c7cf-4b9b-8744-7c0ac1e7b998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9f8412-2c3d-4264-836a-f491c5cf845f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:56 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Volume 16751569-a2b0-42db-942d-0fc73be21583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16751569-a2b0-42db-942d-0fc73be21583', 'volume_size': 1}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:56 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Volume volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180 (f0352f0e-5bf4-4e4d-acd2-36b2fcf24180): created successfully
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c369ff-372c-4a40-b45a-cecc1d489006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Flow 'volume_create_manager' (a7edc160-ade6-4b4c-a1e3-e8bdb43f7256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:56 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-bec9ea52-f850-4658-ba58-43c8c94cf5d0 tempest-CreateVolumesFromImageTest-1486923323 None] Created volume successfully.
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Flow 'volume_create_manager' (792867ee-bdb4-441f-bf47-8a65559d20c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618a0be0-7c30-4646-8986-2fe2a3301a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618a0be0-7c30-4646-8986-2fe2a3301a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-731484563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891bb2a6-eb0b-4106-b158-b7651812f013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e093e24d81ed47c6ba1ae95f94005426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:56Z,use_quota=True,user_id='4349c8f31482452ca52157f740e90c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58ed441-942c-45e9-bc8b-465c88d48170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58ed441-942c-45e9-bc8b-465c88d48170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb496c93-c2c1-4df7-be42-69c24ba54750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb496c93-c2c1-4df7-be42-69c24ba54750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '891bb2a6-eb0b-4106-b158-b7651812f013', 'volume_name': 'volume-891bb2a6-eb0b-4106-b158-b7651812f013', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2ed4af-4775-44fc-a355-7accb860f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2ed4af-4775-44fc-a355-7accb860f15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e753566-570b-41dd-8118-d2f85b35c99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:56 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Volume 891bb2a6-eb0b-4106-b158-b7651812f013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-891bb2a6-eb0b-4106-b158-b7651812f013', 'volume_size': 1}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:56 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95 1073741824" returned: 0 in 0.602s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:56 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95
Nov 02 10:23:56 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:57 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95" returned: 0 in 0.315s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.093s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1039993319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18340779-b35a-4865-8543-c627b18dd08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0b44fe3ddc64ee0901d915bab98016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:55Z,use_quota=True,user_id='a380c11d5e884ba7995f97061aab0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Creating volume 18340779-b35a-4865-8543-c627b18dd08a {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:57 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c057bb-c3a2-4ca0-9993-4e09919e27bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac484de-62fc-4343-89c0-e1c27c080f95', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:57 devstack sudo[106616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a 1073741824
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3da5876-0268-419a-a339-6d23af034e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:57 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:57 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Volume volume-0ac484de-62fc-4343-89c0-e1c27c080f95 (0ac484de-62fc-4343-89c0-e1c27c080f95): created successfully
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3da5876-0268-419a-a339-6d23af034e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Flow 'volume_create_manager' (96e50985-7972-43e2-8b6d-c82a21772f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1cd8953c-26b8-4212-9858-78aaea3e5993 tempest-CreateVolumesFromImageTest-1486923323 None] Created volume successfully.
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Flow 'volume_create_manager' (71dadb8b-7033-4ac9-8e7d-8f8c8f2913f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc34389-743f-4062-88c9-f5fd02e9acc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc34389-743f-4062-88c9-f5fd02e9acc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240ab5db-323e-49b5-8558-1cc60224a0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7afacf773e449ca3ae0d5f251ca195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:57Z,use_quota=True,user_id='fa5a53ee144144abbfc38a215f285206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57122f06-0800-4c44-8b88-b0b7abe8fb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57122f06-0800-4c44-8b88-b0b7abe8fb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96808cba-f949-4b83-b3c2-becbfa5e7165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.image.glance [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Creating Keystone auth plugin from conf {{(pid=87014) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 02 10:23:57 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a 1073741824" returned: 0 in 0.570s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96808cba-f949-4b83-b3c2-becbfa5e7165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '240ab5db-323e-49b5-8558-1cc60224a0da', 'volume_name': 'volume-240ab5db-323e-49b5-8558-1cc60224a0da', 'volume_size': 1, 'image_id': '8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52a7fc92e0658f1efd56cdb621cd5e7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b7afacf773e449ca3ae0d5f251ca195', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '97387721def22d5925dec9c66839aff5bf5efc6167babb89f3d23184d55561bf5d11db5b57d8c0c51d32dfc5066111c79a185166f0a419218d7434313d7445c3', 'id': '8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'created_at': datetime.datetime(2026, 11, 2, 9, 23, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 23, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2eee9700>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d20046-187a-4052-a2d3-eb88c7716ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d20046-187a-4052-a2d3-eb88c7716ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9fed37-529c-454a-9b73-b02ab9298154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:57 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Volume 240ab5db-323e-49b5-8558-1cc60224a0da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-240ab5db-323e-49b5-8558-1cc60224a0da', 'volume_size': 1, 'image_id': '8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52a7fc92e0658f1efd56cdb621cd5e7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b7afacf773e449ca3ae0d5f251ca195', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '97387721def22d5925dec9c66839aff5bf5efc6167babb89f3d23184d55561bf5d11db5b57d8c0c51d32dfc5066111c79a185166f0a419218d7434313d7445c3', 'id': '8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'created_at': datetime.datetime(2026, 11, 2, 9, 23, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 23, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2eee9700>}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Trying to clone 240ab5db-323e-49b5-8558-1cc60224a0da from image 8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'metadata': {}}]). {{(pid=87014) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:57 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a
Nov 02 10:23:57 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 02 10:23:57 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Image download 0.00 MB at 0.00 MB/s
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f61fe5-2662-4a42-8fb7-0a0fc1b57308]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:58 devstack sudo[106627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD
Nov 02 10:23:58 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:58 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a" returned: 0 in 0.280s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.106s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-116514547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853013f8-0c3d-4f79-8c78-ba9bd9f03f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0b44fe3ddc64ee0901d915bab98016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:56Z,use_quota=True,user_id='a380c11d5e884ba7995f97061aab0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Creating volume 853013f8-0c3d-4f79-8c78-ba9bd9f03f6a {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:58 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a273e2e7-20a0-404c-a458-d30f2f5cccd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18340779-b35a-4865-8543-c627b18dd08a', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:58 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a 1073741824
Nov 02 10:23:58 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bf2782-37c8-46a0-8da0-cfa081bed8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:58 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Volume volume-18340779-b35a-4865-8543-c627b18dd08a (18340779-b35a-4865-8543-c627b18dd08a): created successfully
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bf2782-37c8-46a0-8da0-cfa081bed8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Flow 'volume_create_manager' (8178768d-b0c4-4661-8564-e17dcc476f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:58 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fd56e7d7-f446-490e-9269-26410a65ebeb tempest-CreateVolumesFromImageTest-1486923323 None] Created volume successfully.
Nov 02 10:23:58 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:58 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD
Nov 02 10:23:58 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Flow 'volume_create_manager' (de37fbe7-d238-469c-b867-d392dec1b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de48d16a-232b-4478-8171-76a18e4b1f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de48d16a-232b-4478-8171-76a18e4b1f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74d3815-03ed-491b-bab7-48665dbe9c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff4bca2d624a86a442573a1800f914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:59Z,use_quota=True,user_id='2da97d3422f84e8eafaf5ea48b73af52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92648589-3545-4133-921b-f5d1a7ef0d20),volume_type_id=92648589-3545-4133-921b-f5d1a7ef0d20)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53885afc-bd34-4db9-938f-d99357e6b4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53885afc-bd34-4db9-938f-d99357e6b4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadfc7dc-e54c-40d9-a435-f9f193be5d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.image.glance [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Creating Keystone auth plugin from conf {{(pid=87014) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 02 10:23:58 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a 1073741824" returned: 0 in 0.582s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:58 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD" returned: 1 in 0.408s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Temporary image 8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4 is fetched for user fa5a53ee144144abbfc38a215f285206. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 02 10:23:58 devstack sudo[106642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a
Nov 02 10:23:58 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc71c7ff-a6ec-4dc1-9c5f-6b3e837f3276]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadfc7dc-e54c-40d9-a435-f9f193be5d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b74d3815-03ed-491b-bab7-48665dbe9c13', 'volume_name': 'volume-b74d3815-03ed-491b-bab7-48665dbe9c13', 'volume_size': 1, 'image_id': 'e551a571-9866-4d3d-a713-15690617361d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e551a571-9866-4d3d-a713-15690617361d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9b9bee45006a7e6c5814d0f82be26753', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dcff4bca2d624a86a442573a1800f914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c36f48b8dcbcc03084a2bbb00ce988cff050952c4d13741646f4413accf48c76ecd648737969e23c9472234fecbf9aadc8768ed56b50f748761d05e89ce0f625', 'id': 'e551a571-9866-4d3d-a713-15690617361d', 'created_at': datetime.datetime(2026, 11, 2, 9, 23, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 23, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e551a571-9866-4d3d-a713-15690617361d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f042fc0>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed00b2ee-1c45-4b08-b822-fe52a5bbb817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed00b2ee-1c45-4b08-b822-fe52a5bbb817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f335be-ab93-4058-bae6-aa967f2e044d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:58 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Volume b74d3815-03ed-491b-bab7-48665dbe9c13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b74d3815-03ed-491b-bab7-48665dbe9c13', 'volume_size': 1, 'image_id': 'e551a571-9866-4d3d-a713-15690617361d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e551a571-9866-4d3d-a713-15690617361d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9b9bee45006a7e6c5814d0f82be26753', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dcff4bca2d624a86a442573a1800f914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c36f48b8dcbcc03084a2bbb00ce988cff050952c4d13741646f4413accf48c76ecd648737969e23c9472234fecbf9aadc8768ed56b50f748761d05e89ce0f625', 'id': 'e551a571-9866-4d3d-a713-15690617361d', 'created_at': datetime.datetime(2026, 11, 2, 9, 23, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 23, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e551a571-9866-4d3d-a713-15690617361d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f042fc0>}
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Trying to clone b74d3815-03ed-491b-bab7-48665dbe9c13 from image e551a571-9866-4d3d-a713-15690617361d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e551a571-9866-4d3d-a713-15690617361d', 'metadata': {}}]). {{(pid=87014) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 02 10:23:58 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD
Nov 02 10:23:58 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:58 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 02 10:23:58 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Image download 0.00 MB at 0.00 MB/s
Nov 02 10:23:59 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a" returned: 0 in 0.284s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.630s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1148803430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16751569-a2b0-42db-942d-0fc73be21583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0b44fe3ddc64ee0901d915bab98016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:56Z,use_quota=True,user_id='a380c11d5e884ba7995f97061aab0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Creating volume 16751569-a2b0-42db-942d-0fc73be21583 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:59 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:59 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583 1073741824
Nov 02 10:23:59 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c33286-5db3-4888-999a-97f2c244da34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5caa3e-e0f6-4eb7-8071-9049ba09bbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1af46f-f3dc-4a0c-9b68-229e6b7095a2]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:59 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Volume volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a (853013f8-0c3d-4f79-8c78-ba9bd9f03f6a): created successfully
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5caa3e-e0f6-4eb7-8071-9049ba09bbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Flow 'volume_create_manager' (d76f2faf-557b-42d3-a930-14583de43d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:23:59 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0148b6bb-9512-405c-94bb-d2780d76a100 tempest-CreateVolumesFromImageTest-1486923323 None] Created volume successfully.
Nov 02 10:23:59 devstack sudo[106650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD
Nov 02 10:23:59 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:59 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:59 devstack sudo[106654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD
Nov 02 10:23:59 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:59 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:59 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD
Nov 02 10:23:59 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:59 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD" returned: 1 in 0.398s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:59 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583 1073741824" returned: 0 in 0.589s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:59 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583
Nov 02 10:23:59 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:59 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Temporary image e551a571-9866-4d3d-a713-15690617361d is fetched for user 2da97d3422f84e8eafaf5ea48b73af52. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25a9a3d-c6c6-4735-a847-6eccab01710a]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:59 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583" returned: 0 in 0.276s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.335s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-731484563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891bb2a6-eb0b-4106-b158-b7651812f013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e093e24d81ed47c6ba1ae95f94005426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:56Z,use_quota=True,user_id='4349c8f31482452ca52157f740e90c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Creating volume 891bb2a6-eb0b-4106-b158-b7651812f013 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:23:59 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9f8412-2c3d-4264-836a-f491c5cf845f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16751569-a2b0-42db-942d-0fc73be21583', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:23:59 devstack sudo[106674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013 1073741824
Nov 02 10:23:59 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ae77e3-58a7-4236-bef3-8714daa221b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:23:59 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Volume volume-16751569-a2b0-42db-942d-0fc73be21583 (16751569-a2b0-42db-942d-0fc73be21583): created successfully
Nov 02 10:23:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ae77e3-58a7-4236-bef3-8714daa221b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Flow 'volume_create_manager' (e196cd6f-7259-420a-ba0a-bfba8778652f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:00 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-446471a6-6a3d-485b-a99c-4602ca625855 tempest-CreateVolumesFromImageTest-1486923323 None] Created volume successfully.
Nov 02 10:24:00 devstack sudo[106673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD
Nov 02 10:24:00 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:00 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:00 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013 1073741824" returned: 0 in 0.436s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:00 devstack sudo[106683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD
Nov 02 10:24:00 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:00 devstack sudo[106685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013
Nov 02 10:24:00 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:00 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:00 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013" returned: 0 in 0.294s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.112s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240ab5db-323e-49b5-8558-1cc60224a0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7afacf773e449ca3ae0d5f251ca195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:57Z,use_quota=True,user_id='fa5a53ee144144abbfc38a215f285206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Creating volume 240ab5db-323e-49b5-8558-1cc60224a0da {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:00 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "cinder-16751569-a2b0-42db-942d-0fc73be21583-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:00 devstack sudo[106691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da 1073741824
Nov 02 10:24:00 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e753566-570b-41dd-8118-d2f85b35c99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891bb2a6-eb0b-4106-b158-b7651812f013', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8638d5f-cddd-4b5b-999a-277f23f696c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-16751569-a2b0-42db-942d-0fc73be21583-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:00 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Volume volume-891bb2a6-eb0b-4106-b158-b7651812f013 (891bb2a6-eb0b-4106-b158-b7651812f013): created successfully
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8638d5f-cddd-4b5b-999a-277f23f696c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Flow 'volume_create_manager' (792867ee-bdb4-441f-bf47-8a65559d20c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:00 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-62fe8c4c-088e-4687-9643-ee582ea11e94 tempest-CinderUnicodeTest-947653795 None] Created volume successfully.
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "cinder-quobyte-16751569-a2b0-42db-942d-0fc73be21583" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-quobyte-16751569-a2b0-42db-942d-0fc73be21583" acquired by "delete_volume" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c606e360-b5b5-4dd3-be05-b3d083f6ad7e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:01 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583
Nov 02 10:24:01 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:01 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da 1073741824" returned: 0 in 0.447s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:01 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da
Nov 02 10:24:01 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:01 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583" returned: 0 in 0.398s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:01 devstack sudo[106704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583
Nov 02 10:24:01 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:01 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da" returned: 0 in 0.241s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.836s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74d3815-03ed-491b-bab7-48665dbe9c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff4bca2d624a86a442573a1800f914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:23:59Z,use_quota=True,user_id='2da97d3422f84e8eafaf5ea48b73af52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92648589-3545-4133-921b-f5d1a7ef0d20),volume_type_id=92648589-3545-4133-921b-f5d1a7ef0d20)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Creating volume b74d3815-03ed-491b-bab7-48665dbe9c13 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:01 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:01 devstack sudo[106707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13 1073741824
Nov 02 10:24:01 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Attempting download of 8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'metadata': {}}])) to volume 240ab5db-323e-49b5-8558-1cc60224a0da. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 02 10:24:01 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-16751569-a2b0-42db-942d-0fc73be21583" returned: 0 in 0.274s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-quobyte-16751569-a2b0-42db-942d-0fc73be21583" released by "delete_volume" :: held 0.737s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dec606-606c-466b-8d54-e787fc586d61]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_s6q5vg_3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Created reservations ['c5c6f821-d83f-4ae5-847a-4e041b2bd344', 'f42ea424-aa1e-4c80-b710-d267a32b46c8', '62cb99e5-98e5-4324-980f-389908de67ac', '9d321900-8c90-4d97-8ba7-914e1309ff1a'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:01 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_s6q5vg_3
Nov 02 10:24:01 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:01 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:01 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "cinder-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:02 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:02 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_s6q5vg_3" returned: 0 in 0.492s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_s6q5vg_3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13 1073741824" returned: 0 in 0.664s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "cinder-quobyte-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-quobyte-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a" acquired by "delete_volume" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:02 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.422s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:02 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Deleted volume successfully.
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b125785d-0e72-491f-9fff-67fcb99d5f49]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:02 devstack sudo[106722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13
Nov 02 10:24:02 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:02 devstack sudo[106720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_s6q5vg_3
Nov 02 10:24:02 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e332e-ba64-486d-bd87-6ea8bd53429d tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-16751569-a2b0-42db-942d-0fc73be21583-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:02 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a
Nov 02 10:24:02 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:02 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_s6q5vg_3" returned: 1 in 0.363s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_s6q5vg_3' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:24:02 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[014ed208-04d7-4bc7-a1bd-c782b33ec8ac]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13" returned: 0 in 0.268s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.287s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] Creating offline snapshot 26832afd-7bc4-42e0-8494-474822ce5800 of volume 891bb2a6-eb0b-4106-b158-b7651812f013 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Attempting download of e551a571-9866-4d3d-a713-15690617361d ((None, [{'url': 'file:///opt/stack/data/glance/images/e551a571-9866-4d3d-a713-15690617361d', 'metadata': {}}])) to volume b74d3815-03ed-491b-bab7-48665dbe9c13. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e3ecf4-4617-4203-9733-9e070303ff10]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdf4f18-aff5-426e-8dbe-b62514384fb6]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e551a571-9866-4d3d-a713-15690617361d_7xupt88x {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:02 devstack sudo[106730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD
Nov 02 10:24:02 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:02 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a" returned: 0 in 0.443s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:02 devstack sudo[106731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013
Nov 02 10:24:02 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:02 devstack sudo[106737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a
Nov 02 10:24:02 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:02 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e551a571-9866-4d3d-a713-15690617361d_7xupt88x
Nov 02 10:24:02 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:02 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:02 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a" returned: 0 in 0.288s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:02 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013" returned: 0 in 0.450s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-quobyte-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a" released by "delete_volume" :: held 0.815s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:02 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e551a571-9866-4d3d-a713-15690617361d_7xupt88x" returned: 0 in 0.404s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e551a571-9866-4d3d-a713-15690617361d_7xupt88x {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:03 devstack sudo[106750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800 1G
Nov 02 10:24:03 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:03 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD
Nov 02 10:24:03 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Created reservations ['41eac193-ee06-4a38-8828-b8f806519f63', '1cdf5970-ea15-4ac7-bc02-253ab2409755', 'ab2a537c-263b-4c72-89ec-156edb5c22e3', '1706d1ff-da90-45bb-9768-5a8c07012ff7'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:03 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e551a571-9866-4d3d-a713-15690617361d_7xupt88x
Nov 02 10:24:03 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:03 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:03 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "cinder-18340779-b35a-4865-8543-c627b18dd08a-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-18340779-b35a-4865-8543-c627b18dd08a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:03 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD" returned: 1 in 0.446s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] 8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4 was raw, converting to qcow2 {{(pid=87014) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "cinder-quobyte-18340779-b35a-4865-8543-c627b18dd08a" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:03 devstack sudo[106763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da
Nov 02 10:24:03 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-quobyte-18340779-b35a-4865-8543-c627b18dd08a" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:03 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e551a571-9866-4d3d-a713-15690617361d_7xupt88x" returned: 1 in 0.432s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e551a571-9866-4d3d-a713-15690617361d_7xupt88x' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d81aa5a-9b2e-4940-b189-89ddb363f799]: (4, 'raw') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f574b7-5cdf-47e9-a8c0-961fe585f4b6]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:03 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.374s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:03 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Deleted volume successfully.
Nov 02 10:24:03 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800 1G" returned: 0 in 0.616s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891bb2a6-eb0b-4106-b158-b7651812f013 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:03 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD
Nov 02 10:24:03 devstack sudo[106768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a
Nov 02 10:24:03 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:03 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9e93af11-d135-4fb3-b6a4-43951e79060a tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-853013f8-0c3d-4f79-8c78-ba9bd9f03f6a-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:03 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891bb2a6-eb0b-4106-b158-b7651812f013 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800
Nov 02 10:24:03 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:03 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:03 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da" returned: 0 in 0.591s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4_hogghy50devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:24:03 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Converted 0.00 MB image at 0.00 MB/s
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:03 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a" returned: 0 in 0.506s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:03 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da 1G
Nov 02 10:24:03 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:03 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a
Nov 02 10:24:03 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:04 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891bb2a6-eb0b-4106-b158-b7651812f013 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800" returned: 0 in 0.410s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:04 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800 is being set with open permissions: ugo+rw
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:04 devstack sudo[106793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800
Nov 02 10:24:04 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:04 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD
Nov 02 10:24:04 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:04 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-18340779-b35a-4865-8543-c627b18dd08a" returned: 0 in 0.281s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-quobyte-18340779-b35a-4865-8543-c627b18dd08a" released by "delete_volume" :: held 0.852s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:04 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800" returned: 0 in 0.271s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:04 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:04 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da 1G" returned: 0 in 0.368s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Downloaded image 8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'metadata': {}}])) to volume 240ab5db-323e-49b5-8558-1cc60224a0da successfully. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Temporary image 8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4 for user fa5a53ee144144abbfc38a215f285206 is deleted. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Marking volume 240ab5db-323e-49b5-8558-1cc60224a0da as bootable. {{(pid=87014) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] e551a571-9866-4d3d-a713-15690617361d was raw, converting to qcow2 {{(pid=87014) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:04 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.info
Nov 02 10:24:04 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Copying metadata from image 8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4 to 240ab5db-323e-49b5-8558-1cc60224a0da. {{(pid=87014) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Creating volume glance metadata for volume 240ab5db-323e-49b5-8558-1cc60224a0da backed by image 8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4 with: {'image_id': '8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '52a7fc92e0658f1efd56cdb621cd5e7c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87014) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 02 10:24:04 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13
Nov 02 10:24:04 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Created reservations ['322c3472-587a-4540-b871-3abb8d019d7d', '74445564-1161-47ed-b40b-dfc1bbc2fc9b', '69e876a8-51f6-486b-b0e2-12030fe9b900', 'ae86b9a0-5751-4f51-84a1-ceffd3a7543b'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9fed37-529c-454a-9b73-b02ab9298154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240ab5db-323e-49b5-8558-1cc60224a0da', 'volume_size': 1, 'image_id': '8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52a7fc92e0658f1efd56cdb621cd5e7c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1b7afacf773e449ca3ae0d5f251ca195', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '97387721def22d5925dec9c66839aff5bf5efc6167babb89f3d23184d55561bf5d11db5b57d8c0c51d32dfc5066111c79a185166f0a419218d7434313d7445c3', 'id': '8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4', 'created_at': datetime.datetime(2026, 11, 2, 9, 23, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 23, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b60d4b5-b27b-43bd-bb18-f5e3a283f9e4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2eee9700>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf8c6d6-44c1-4eb1-8fbd-059cf5745514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:04 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Volume volume-240ab5db-323e-49b5-8558-1cc60224a0da (240ab5db-323e-49b5-8558-1cc60224a0da): created successfully
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf8c6d6-44c1-4eb1-8fbd-059cf5745514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:04 devstack sudo[106809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:04 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Flow 'volume_create_manager' (71dadb8b-7033-4ac9-8e7d-8f8c8f2913f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:04 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f4f02853-520c-48ae-ab79-a3a6b2687f31 tempest-VolumeImageDependencyTests-984900068 None] Created volume successfully.
Nov 02 10:24:04 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.info" returned: 0 in 0.320s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:04 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.info is being set with open permissions: ugo+rw
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:04 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.info
Nov 02 10:24:04 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:04 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.332s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:04 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Deleted volume successfully.
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9d8de791-2d2e-4e67-8e2b-4b22ed346c17 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-18340779-b35a-4865-8543-c627b18dd08a-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:04 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13" returned: 0 in 0.621s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e551a571-9866-4d3d-a713-15690617361d_cypkjvrddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:24:04 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Converted 0.00 MB image at 0.00 MB/s
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:04 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.info" returned: 0 in 0.328s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:04 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13 1G
Nov 02 10:24:04 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Acquiring lock "cinder-240ab5db-323e-49b5-8558-1cc60224a0da-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Lock "cinder-240ab5db-323e-49b5-8558-1cc60224a0da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:05 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f20443ed-c999-45f5-95a9-2b0192df6c3d tempest-CinderUnicodeTest-947653795 None] Create snapshot completed successfully
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Acquiring lock "cinder-quobyte-240ab5db-323e-49b5-8558-1cc60224a0da" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Lock "cinder-quobyte-240ab5db-323e-49b5-8558-1cc60224a0da" acquired by "delete_volume" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a27645-7a82-443a-bed0-a88f2c44022c]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:05 devstack sudo[106824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da
Nov 02 10:24:05 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:05 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13 1G" returned: 0 in 0.401s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Downloaded image e551a571-9866-4d3d-a713-15690617361d ((None, [{'url': 'file:///opt/stack/data/glance/images/e551a571-9866-4d3d-a713-15690617361d', 'metadata': {}}])) to volume b74d3815-03ed-491b-bab7-48665dbe9c13 successfully. {{(pid=87014) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Temporary image e551a571-9866-4d3d-a713-15690617361d for user 2da97d3422f84e8eafaf5ea48b73af52 is deleted. {{(pid=87014) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.volume.volume_utils [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Marking volume b74d3815-03ed-491b-bab7-48665dbe9c13 as bootable. {{(pid=87014) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "cinder-26832afd-7bc4-42e0-8494-474822ce5800-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Copying metadata from image e551a571-9866-4d3d-a713-15690617361d to b74d3815-03ed-491b-bab7-48665dbe9c13. {{(pid=87014) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Creating volume glance metadata for volume b74d3815-03ed-491b-bab7-48665dbe9c13 backed by image e551a571-9866-4d3d-a713-15690617361d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e551a571-9866-4d3d-a713-15690617361d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9b9bee45006a7e6c5814d0f82be26753', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87014) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-26832afd-7bc4-42e0-8494-474822ce5800-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "cinder-quobyte-891bb2a6-eb0b-4106-b158-b7651812f013" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-quobyte-891bb2a6-eb0b-4106-b158-b7651812f013" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "cinder-quobyte-26832afd-7bc4-42e0-8494-474822ce5800" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-quobyte-26832afd-7bc4-42e0-8494-474822ce5800" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Deleting offline snapshot 26832afd-7bc4-42e0-8494-474822ce5800 of volume 891bb2a6-eb0b-4106-b158-b7651812f013 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] snapshot_file for this snap is: volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1d02f3-142c-4b0f-8026-9eba64ee52b6]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:05 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da" returned: 0 in 0.428s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:05 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f335be-ab93-4058-bae6-aa967f2e044d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b74d3815-03ed-491b-bab7-48665dbe9c13', 'volume_size': 1, 'image_id': 'e551a571-9866-4d3d-a713-15690617361d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e551a571-9866-4d3d-a713-15690617361d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9b9bee45006a7e6c5814d0f82be26753', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dcff4bca2d624a86a442573a1800f914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c36f48b8dcbcc03084a2bbb00ce988cff050952c4d13741646f4413accf48c76ecd648737969e23c9472234fecbf9aadc8768ed56b50f748761d05e89ce0f625', 'id': 'e551a571-9866-4d3d-a713-15690617361d', 'created_at': datetime.datetime(2026, 11, 2, 9, 23, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 9, 23, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e551a571-9866-4d3d-a713-15690617361d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x754f2f042fc0>}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:05 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc645d4-5947-48dd-b2ba-15931c259f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "cinder-0ac484de-62fc-4343-89c0-e1c27c080f95-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:05 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Volume volume-b74d3815-03ed-491b-bab7-48665dbe9c13 (b74d3815-03ed-491b-bab7-48665dbe9c13): created successfully
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc645d4-5947-48dd-b2ba-15931c259f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Flow 'volume_create_manager' (de37fbe7-d238-469c-b867-d392dec1b56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-0ac484de-62fc-4343-89c0-e1c27c080f95-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:05 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-715ce569-e72a-4ed9-9c5d-3c99c011bc5c tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Created volume successfully.
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "cinder-quobyte-0ac484de-62fc-4343-89c0-e1c27c080f95" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-quobyte-0ac484de-62fc-4343-89c0-e1c27c080f95" acquired by "delete_volume" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:05 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800
Nov 02 10:24:05 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d404f78-03b6-4f87-8af1-ee2d29cd43f3]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:05 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-240ab5db-323e-49b5-8558-1cc60224a0da" returned: 0 in 0.288s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Lock "cinder-quobyte-240ab5db-323e-49b5-8558-1cc60224a0da" released by "delete_volume" :: held 0.762s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:05 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95
Nov 02 10:24:05 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:05 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Created reservations ['2eacf9c1-0836-4fcf-a7ec-71586d93b69e', '7232dd94-984d-4e55-a50a-76e686f999b6', '724e191a-e418-4eb7-a842-9869b4b21098', '0fc6c2ea-e206-4190-8ece-305c1cb3343a'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:06 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800" returned: 0 in 0.505s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-891bb2a6-eb0b-4106-b158-b7651812f013(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:24:06 devstack sudo[106842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:06 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b50d4a-e784-49ea-813a-9b1296a1419f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Acquiring lock "cinder-b74d3815-03ed-491b-bab7-48665dbe9c13-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Lock "cinder-b74d3815-03ed-491b-bab7-48665dbe9c13-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Acquiring lock "cinder-quobyte-b74d3815-03ed-491b-bab7-48665dbe9c13" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:06 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013
Nov 02 10:24:06 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Lock "cinder-quobyte-b74d3815-03ed-491b-bab7-48665dbe9c13" acquired by "delete_volume" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:06 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95" returned: 0 in 0.546s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:06 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ece4ec6-a7f8-4270-ab11-b6d24e048a2f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.388s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:06 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Deleted volume successfully.
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06ff745f-527d-4720-8154-127b6c999f62 tempest-VolumeImageDependencyTests-984900068 None] Lock "cinder-240ab5db-323e-49b5-8558-1cc60224a0da-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:06 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:06 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:06 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13
Nov 02 10:24:06 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:06 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013" returned: 0 in 0.645s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:06 devstack sudo[106861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800
Nov 02 10:24:06 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:06 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0ac484de-62fc-4343-89c0-e1c27c080f95" returned: 0 in 0.512s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-quobyte-0ac484de-62fc-4343-89c0-e1c27c080f95" released by "delete_volume" :: held 1.120s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Created reservations ['a113cf06-2971-432b-b249-2bab641682fd', '7b79e188-9c12-40b7-b61f-948942225385', '373f4d0a-6a5d-4648-8990-4249ed6f3f66', '0b78e987-c507-4c55-a2cf-4616c1978aeb'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:06 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13" returned: 0 in 0.652s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:07 devstack sudo[106866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13
Nov 02 10:24:07 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:07 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:07 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:07 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800" returned: 0 in 0.491s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:07 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800
Nov 02 10:24:07 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:07 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-b74d3815-03ed-491b-bab7-48665dbe9c13" returned: 0 in 0.340s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:07 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:07 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Lock "cinder-quobyte-b74d3815-03ed-491b-bab7-48665dbe9c13" released by "delete_volume" :: held 1.077s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:07 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.341s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Deleted volume successfully.
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Created reservations ['2a5b072b-77c1-4e0b-a30a-b40197ee5261', 'e6377d60-8d25-4ff5-8c13-85aee221915b', 'ee2ada8d-65c7-4846-9dda-d40a73ee3cfc', 'ba7ab329-0f68-4b2e-8f10-edab3d2e464c'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1bea1fd1-be1b-4f0a-8bbe-e10dc8f00651 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-0ac484de-62fc-4343-89c0-e1c27c080f95-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:07 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013.26832afd-7bc4-42e0-8494-474822ce5800" returned: 0 in 0.343s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:07 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.336s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-quobyte-26832afd-7bc4-42e0-8494-474822ce5800" released by "_delete_snapshot" :: held 2.155s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:07 devstack sudo[106882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:07 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-quobyte-891bb2a6-eb0b-4106-b158-b7651812f013" released by "delete_snapshot" :: held 2.202s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Created reservations ['261d8846-12de-48b4-b650-3e2b184a7e53', '19e62859-922c-493c-a11c-b14ca82ef87d', '44c48a39-ef38-4c71-87ff-030940e8168c', '82f1620d-74b7-4541-8f97-a48520356847'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Delete snapshot completed successfully.
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7bf3a763-d497-49e5-bb35-da3099feeb88 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-26832afd-7bc4-42e0-8494-474822ce5800-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "cinder-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:07 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.362s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Deleted volume successfully.
Nov 02 10:24:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "cinder-quobyte-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-00a72aec-49f2-4984-94e6-aa118c6e5f2f tempest-VolumeAndVolumeTypeFromImageTest-1874011805 None] Lock "cinder-b74d3815-03ed-491b-bab7-48665dbe9c13-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-quobyte-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180" acquired by "delete_volume" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d419db-3296-48eb-a9c6-52b6c13d485a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:08 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180
Nov 02 10:24:08 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:08 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180" returned: 0 in 0.416s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:08 devstack sudo[106890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180
Nov 02 10:24:08 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "cinder-891bb2a6-eb0b-4106-b158-b7651812f013-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-891bb2a6-eb0b-4106-b158-b7651812f013-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "cinder-quobyte-891bb2a6-eb0b-4106-b158-b7651812f013" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-quobyte-891bb2a6-eb0b-4106-b158-b7651812f013" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:08 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180" returned: 0 in 0.362s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48912e6-5fd5-473b-ba04-b45c59d3b309]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-quobyte-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180" released by "delete_volume" :: held 0.840s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:08 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Created reservations ['98e0ca6b-7a52-49c3-9367-0a26ee8e6cf6', '64cce0a2-7ba1-470e-a033-5bd13fea3152', '134bea52-80af-4a19-bbaf-f5015ec4d17f', '6dc7a3c7-c0fd-4e1f-bb26-9d3a8785fcfb'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:08 devstack sudo[106893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013
Nov 02 10:24:08 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:09 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:09 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:09 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013" returned: 0 in 0.450s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:09 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.303s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:09 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013
Nov 02 10:24:09 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Deleted volume successfully.
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6c819527-1aae-4d1c-9c50-eb1ea4456f82 tempest-CreateVolumesFromImageTest-1486923323 None] Lock "cinder-f0352f0e-5bf4-4e4d-acd2-36b2fcf24180-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:09 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-891bb2a6-eb0b-4106-b158-b7651812f013" returned: 0 in 0.282s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-quobyte-891bb2a6-eb0b-4106-b158-b7651812f013" released by "delete_volume" :: held 0.818s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Created reservations ['659091b0-32ab-48c7-aa72-72c17d73dde7', '76f13d1e-1960-4d2c-8392-9baab1af9ef7', 'b7f60b31-3532-4ef4-a484-69bb17786e91', 'd4d0a3be-113f-47c9-adb9-181c83ebb105'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:09 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:09 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "cinder-e84d106d-ed6e-424b-9d64-7db84f6ea3af-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-e84d106d-ed6e-424b-9d64-7db84f6ea3af-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "cinder-quobyte-e84d106d-ed6e-424b-9d64-7db84f6ea3af" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-quobyte-e84d106d-ed6e-424b-9d64-7db84f6ea3af" acquired by "delete_volume" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:10 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfc370c-0bea-4e54-b5f3-c4d33c315ec0]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:10 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.381s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:10 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Deleted volume successfully.
Nov 02 10:24:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2ce2c6d2-ae21-4b98-bf6c-d43861d82ab1 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-891bb2a6-eb0b-4106-b158-b7651812f013-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:10 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af
Nov 02 10:24:10 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:10 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af" returned: 0 in 0.559s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:10 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af
Nov 02 10:24:10 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:10 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e84d106d-ed6e-424b-9d64-7db84f6ea3af" returned: 0 in 0.382s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-quobyte-e84d106d-ed6e-424b-9d64-7db84f6ea3af" released by "delete_volume" :: held 1.020s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:11 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Created reservations ['4e8ed255-3314-4dd8-abfb-457b08e22d79', 'bfaa27d9-f29f-438d-bd83-bbed1bd5343f', 'c0d2a200-9f74-4ef0-a03b-0f5b7f9a1a39', '12cde17e-d62f-4097-bdaf-40455a4b6213'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:11 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:11 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:11 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.287s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:11 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:11 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Deleted volume successfully.
Nov 02 10:24:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b7092f86-3383-4f32-b590-83c297c98918 tempest-CinderUnicodeTest-947653795 None] Lock "cinder-e84d106d-ed6e-424b-9d64-7db84f6ea3af-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (c9422a49-83fd-4a41-b429-c0f51910562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e20aad-a4c1-48ec-8b09-f012ddcc8c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e20aad-a4c1-48ec-8b09-f012ddcc8c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261669132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:14Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2cb296-cef2-42b5-a28d-4eb8519326be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2cb296-cef2-42b5-a28d-4eb8519326be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81db245-fdf3-4d8a-8d42-8e14bc2d5888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81db245-fdf3-4d8a-8d42-8e14bc2d5888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0', 'volume_name': 'volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6301e6f9-8f0c-4301-b93f-f0b448a391af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6301e6f9-8f0c-4301-b93f-f0b448a391af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923b9fa0-5f1f-4309-9535-d54bfca08c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:14 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0', 'volume_size': 1}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261669132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:14Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Creating volume e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:14 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:14 devstack sudo[106919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0 1073741824
Nov 02 10:24:14 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:14 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0 1073741824" returned: 0 in 0.581s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:15 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0
Nov 02 10:24:15 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:15 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0" returned: 0 in 0.373s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:15 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923b9fa0-5f1f-4309-9535-d54bfca08c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f47e8a-ae76-4c45-8fbe-708978368c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:15 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0 (e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0): created successfully
Nov 02 10:24:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f47e8a-ae76-4c45-8fbe-708978368c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:15 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (c9422a49-83fd-4a41-b429-c0f51910562c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:15 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-71c5f0e2-30c1-44b5-912b-6e189cbe0d79 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created volume successfully.
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (0650b072-29f6-4a03-a389-30562f303135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3bb58b-6d8a-4197-bf69-f4470871d10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3bb58b-6d8a-4197-bf69-f4470871d10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891338903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a06d19c-6cad-460a-bda6-7ddd294e8e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:16Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64946a3b-18b0-4fc7-b25e-64c86e709cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64946a3b-18b0-4fc7-b25e-64c86e709cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057debbd-34d7-4a40-8b91-fba04c3f6f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057debbd-34d7-4a40-8b91-fba04c3f6f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a06d19c-6cad-460a-bda6-7ddd294e8e11', 'volume_name': 'volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b54b1fc-0f0a-458a-8662-fb5f3ee3d6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b54b1fc-0f0a-458a-8662-fb5f3ee3d6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885c4180-a1eb-4ff9-8404-d858c81fc2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:16 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume 2a06d19c-6cad-460a-bda6-7ddd294e8e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11', 'volume_size': 1}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891338903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a06d19c-6cad-460a-bda6-7ddd294e8e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:16Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Creating volume 2a06d19c-6cad-460a-bda6-7ddd294e8e11 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:16 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:16 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 1073741824
Nov 02 10:24:16 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:16 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 1073741824" returned: 0 in 0.601s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:16 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11
Nov 02 10:24:16 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (9d2d0fe0-5d4a-4ecd-90a6-c215a7bedeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc272ee9-ac40-4589-a4b7-7f6f4bca59dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc272ee9-ac40-4589-a4b7-7f6f4bca59dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-130810860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f120f70b-edaf-41e1-9074-0fd43db1ea74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:17Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b0846d-946e-4098-a085-7b0272177f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b0846d-946e-4098-a085-7b0272177f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa9f88c-c774-45e2-b9ca-5053f01780da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa9f88c-c774-45e2-b9ca-5053f01780da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f120f70b-edaf-41e1-9074-0fd43db1ea74', 'volume_name': 'volume-f120f70b-edaf-41e1-9074-0fd43db1ea74', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10ebdd1-29c2-421e-875e-8453c38234b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10ebdd1-29c2-421e-875e-8453c38234b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52d74f3-8c4e-4931-b162-a2f2eb35f547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume f120f70b-edaf-41e1-9074-0fd43db1ea74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f120f70b-edaf-41e1-9074-0fd43db1ea74', 'volume_size': 1}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-77bf74e7-9e87-467f-ac6d-d6016ec28929 tempest-ProjectAdminTests-530324379 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8322715759277, 'free_capacity_gb': 1773.8322715759277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87014) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 02 10:24:17 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11" returned: 0 in 0.403s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-130810860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f120f70b-edaf-41e1-9074-0fd43db1ea74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:17Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Creating volume f120f70b-edaf-41e1-9074-0fd43db1ea74 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:17 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885c4180-a1eb-4ff9-8404-d858c81fc2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c375d6c-56e4-4aae-b0be-8c7314cd0070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74 1073741824
Nov 02 10:24:17 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:17 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 (2a06d19c-6cad-460a-bda6-7ddd294e8e11): created successfully
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c375d6c-56e4-4aae-b0be-8c7314cd0070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (0650b072-29f6-4a03-a389-30562f303135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:17 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-13804b29-30a8-4a90-9916-1b1673faa538 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created volume successfully.
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (5932e52c-fb45-40a6-9a52-be1b5d907449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a166b654-6e22-42f5-9245-630ab8040856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a166b654-6e22-42f5-9245-630ab8040856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-831386038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f72afc-4b0f-42b2-8dfb-70ff43a51f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:17Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e15c67-1f7e-448b-b77f-eac4711a8dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e15c67-1f7e-448b-b77f-eac4711a8dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47eb16ba-e3c1-442f-8549-a74ed2541ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47eb16ba-e3c1-442f-8549-a74ed2541ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f72afc-4b0f-42b2-8dfb-70ff43a51f82', 'volume_name': 'volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17358094-3cbe-419b-8d49-5e58d6fa7bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17358094-3cbe-419b-8d49-5e58d6fa7bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb8ad77-9f4c-4c61-a979-aa361ba9a0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume 34f72afc-4b0f-42b2-8dfb-70ff43a51f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82', 'volume_size': 1}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (46503886-774f-4292-9a96-c8184da4eab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abf50b3-7f78-4051-b548-23bfbebcae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abf50b3-7f78-4051-b548-23bfbebcae54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1268725591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:18Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d842d5b7-3d32-40b9-85e9-a4151b592869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d842d5b7-3d32-40b9-85e9-a4151b592869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e44361b-3e82-4021-a2e9-7bb5206642e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e44361b-3e82-4021-a2e9-7bb5206642e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11', 'volume_name': 'volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ba379c-4507-4edf-9bcc-396b77e312e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ba379c-4507-4edf-9bcc-396b77e312e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16746d0-a3d3-4ee1-bb10-81132350d3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:17 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11', 'volume_size': 1}
Nov 02 10:24:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:18 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74 1073741824" returned: 0 in 0.838s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:18 devstack sudo[106943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74
Nov 02 10:24:18 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (ee906803-b1b3-41af-bf7e-6a2f737effe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb381d72-ba3b-491e-9e39-f8dc3b435cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb381d72-ba3b-491e-9e39-f8dc3b435cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1978504786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a226d4a-49a8-43e0-ba5c-aa5b0b07148a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:18Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b00494a-1424-4d60-adf2-9c23da37f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:18 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b00494a-1424-4d60-adf2-9c23da37f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8de5c5-294a-43ba-8d05-b8b45f5ec9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8de5c5-294a-43ba-8d05-b8b45f5ec9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a226d4a-49a8-43e0-ba5c-aa5b0b07148a', 'volume_name': 'volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce298a29-4521-46c2-a7d0-8975a5b186d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce298a29-4521-46c2-a7d0-8975a5b186d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ecdc8a-3a13-41c0-88cf-5fe4af470570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:18 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume 1a226d4a-49a8-43e0-ba5c-aa5b0b07148a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a', 'volume_size': 1}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74" returned: 0 in 0.592s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.947s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-831386038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f72afc-4b0f-42b2-8dfb-70ff43a51f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:17Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Creating volume 34f72afc-4b0f-42b2-8dfb-70ff43a51f82 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:18 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52d74f3-8c4e-4931-b162-a2f2eb35f547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f120f70b-edaf-41e1-9074-0fd43db1ea74', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:18 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82 1073741824
Nov 02 10:24:18 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f810904-722f-4eea-9017-d1d11b643f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:18 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume volume-f120f70b-edaf-41e1-9074-0fd43db1ea74 (f120f70b-edaf-41e1-9074-0fd43db1ea74): created successfully
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f810904-722f-4eea-9017-d1d11b643f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:18 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (9d2d0fe0-5d4a-4ecd-90a6-c215a7bedeaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:18 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5948c5ac-68c6-4b0a-9de2-30ab07e6165c tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created volume successfully.
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (e3a2c08f-b2df-487a-9d81-06b3c7998595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b4b49c-e642-40d4-9f13-acdf22486742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b4b49c-e642-40d4-9f13-acdf22486742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-920705971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19920799-505e-47ae-89c6-9fc2ac582a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:19Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882b33d6-4b3d-4977-86e3-cf3d7777d668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882b33d6-4b3d-4977-86e3-cf3d7777d668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0510a2eb-2574-4fce-b35f-698f0390388f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0510a2eb-2574-4fce-b35f-698f0390388f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19920799-505e-47ae-89c6-9fc2ac582a95', 'volume_name': 'volume-19920799-505e-47ae-89c6-9fc2ac582a95', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624b0808-6942-4160-8526-68b0e7b8329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624b0808-6942-4160-8526-68b0e7b8329c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206043da-4859-49c5-b97e-2ba1b8b2bb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:19 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume 19920799-505e-47ae-89c6-9fc2ac582a95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19920799-505e-47ae-89c6-9fc2ac582a95', 'volume_size': 1}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82 1073741824" returned: 0 in 0.642s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:19 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:19 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82
Nov 02 10:24:19 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Flow 'volume_create_manager' (aff577dd-df26-4695-babb-722729d89c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df01162-2390-4523-80f4-7005b6bc8097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df01162-2390-4523-80f4-7005b6bc8097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243122839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98487206-211c-487c-9d8d-35d25b595738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756b2e74d6814b3195170363664c9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:20Z,use_quota=True,user_id='f37cbe15323a4a49b313cf81737e8cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05268187-4666-45a6-9ba8-6052225eb707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05268187-4666-45a6-9ba8-6052225eb707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9743570a-fdbc-4e5e-b1d1-e1d0709a198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9743570a-fdbc-4e5e-b1d1-e1d0709a198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98487206-211c-487c-9d8d-35d25b595738', 'volume_name': 'volume-98487206-211c-487c-9d8d-35d25b595738', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0d6412-dc23-4357-8dec-1b1f62dca7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f0d6412-dc23-4357-8dec-1b1f62dca7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ae894c-b71f-425e-aa1d-e101641ef645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:19 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Volume 98487206-211c-487c-9d8d-35d25b595738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98487206-211c-487c-9d8d-35d25b595738', 'volume_size': 1}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:19 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82" returned: 0 in 0.334s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.786s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1268725591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:18Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Creating volume afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:19 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:19 devstack sudo[106957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11 1073741824
Nov 02 10:24:19 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb8ad77-9f4c-4c61-a979-aa361ba9a0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e245886-1ec8-4959-92d8-3412530c7351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:19 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82 (34f72afc-4b0f-42b2-8dfb-70ff43a51f82): created successfully
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e245886-1ec8-4959-92d8-3412530c7351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (5932e52c-fb45-40a6-9a52-be1b5d907449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-02b6f22e-dc7c-46a8-aa32-fff52970a0d4 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created volume successfully.
Nov 02 10:24:20 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11 1073741824" returned: 0 in 0.485s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:20 devstack sudo[106963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11
Nov 02 10:24:20 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:20 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11" returned: 0 in 0.250s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1978504786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a226d4a-49a8-43e0-ba5c-aa5b0b07148a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:18Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Creating volume 1a226d4a-49a8-43e0-ba5c-aa5b0b07148a {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:20 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:20 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a 1073741824
Nov 02 10:24:20 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16746d0-a3d3-4ee1-bb10-81132350d3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14964b00-be71-4f15-8107-b4e9672716ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:20 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11 (afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11): created successfully
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14964b00-be71-4f15-8107-b4e9672716ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:20 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (46503886-774f-4292-9a96-c8184da4eab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:20 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-01310ed5-f5f2-4ea7-8ca3-74972af89518 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created volume successfully.
Nov 02 10:24:21 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a 1073741824" returned: 0 in 0.457s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:21 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a
Nov 02 10:24:21 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:21 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a" returned: 0 in 0.301s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.595s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ecdc8a-3a13-41c0-88cf-5fe4af470570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50385ee6-1247-401c-8e90-e2dcfda29895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Creating offline snapshot 1134e43e-7545-4917-8af3-a34f8ecb048b of volume 2a06d19c-6cad-460a-bda6-7ddd294e8e11 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:24:21 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a (1a226d4a-49a8-43e0-ba5c-aa5b0b07148a): created successfully
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50385ee6-1247-401c-8e90-e2dcfda29895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (ee906803-b1b3-41af-bf7e-6a2f737effe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d05cc5-b198-4004-8b24-44b8c64dcd99]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:21 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f07f1179-aebf-40de-9b5c-b20e551882cd tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created volume successfully.
Nov 02 10:24:21 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11
Nov 02 10:24:21 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:21 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11" returned: 0 in 0.441s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:21 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b 1G
Nov 02 10:24:21 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:22 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b 1G" returned: 0 in 0.506s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:22 devstack sudo[107024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b
Nov 02 10:24:22 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:22 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b" returned: 0 in 0.326s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:22 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b is being set with open permissions: ugo+rw
Nov 02 10:24:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:22 devstack sudo[107029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b
Nov 02 10:24:22 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:22 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b" returned: 0 in 0.273s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:23 devstack sudo[107032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.info
Nov 02 10:24:23 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:23 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.info" returned: 0 in 0.265s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:23 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.info is being set with open permissions: ugo+rw
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:23 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.info
Nov 02 10:24:23 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:23 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.info" returned: 0 in 0.258s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.378s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-920705971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19920799-505e-47ae-89c6-9fc2ac582a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f002e81847664517aba3173827e675f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:19Z,use_quota=True,user_id='eb2cfc99d7ef4e548c4907ad3b6c0d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Creating volume 19920799-505e-47ae-89c6-9fc2ac582a95 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:23 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:23 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e8642830-3a08-45e1-becf-f1ca7767b065 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Create snapshot completed successfully
Nov 02 10:24:23 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95 1073741824
Nov 02 10:24:23 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:24 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95 1073741824" returned: 0 in 0.547s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:24 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95
Nov 02 10:24:24 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:24 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95" returned: 0 in 0.382s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.832s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243122839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98487206-211c-487c-9d8d-35d25b595738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756b2e74d6814b3195170363664c9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:20Z,use_quota=True,user_id='f37cbe15323a4a49b313cf81737e8cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Creating volume 98487206-211c-487c-9d8d-35d25b595738 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:24 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206043da-4859-49c5-b97e-2ba1b8b2bb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19920799-505e-47ae-89c6-9fc2ac582a95', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fde3df4-45c4-47fa-9f36-d365d6d5ed00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:24 devstack sudo[107047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738 1073741824
Nov 02 10:24:24 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:24 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Volume volume-19920799-505e-47ae-89c6-9fc2ac582a95 (19920799-505e-47ae-89c6-9fc2ac582a95): created successfully
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fde3df4-45c4-47fa-9f36-d365d6d5ed00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Flow 'volume_create_manager' (e3a2c08f-b2df-487a-9d81-06b3c7998595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (e8ac412b-1acd-43df-ab8f-73ab472581da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e202a89d-71de-4905-8ca8-66c0457b989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e202a89d-71de-4905-8ca8-66c0457b989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-140415856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0031215b-44ad-42b1-b34a-1f9cd17a8b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:25Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0cb641-0dcb-494a-8fd8-e8e71b9664c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0cb641-0dcb-494a-8fd8-e8e71b9664c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9acfdd4-24c2-4f9c-8d1d-c6d146d68e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9acfdd4-24c2-4f9c-8d1d-c6d146d68e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0031215b-44ad-42b1-b34a-1f9cd17a8b8c', 'volume_name': 'volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba652ec-a658-4680-9469-ebed16c41b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba652ec-a658-4680-9469-ebed16c41b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27af7340-46c6-4715-9940-41b3e6f6f331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:24 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume 0031215b-44ad-42b1-b34a-1f9cd17a8b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c', 'volume_size': 1}
Nov 02 10:24:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:24 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ef376622-2c80-4b80-b842-e1c1d9ffebbc tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created volume successfully.
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (617a887d-12cc-4ba3-bee9-b512f5cfd85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1a0918-9b5b-4860-b648-968d96e8388d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:25 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1a0918-9b5b-4860-b648-968d96e8388d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-630650473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f154b406-b1ea-4bf9-aeca-c726a0544559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:25Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d6ebad-d60f-42c5-aebd-de7f93c7f616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d6ebad-d60f-42c5-aebd-de7f93c7f616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf15a00-32fc-4052-be98-3a9620b24311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf15a00-32fc-4052-be98-3a9620b24311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f154b406-b1ea-4bf9-aeca-c726a0544559', 'volume_name': 'volume-f154b406-b1ea-4bf9-aeca-c726a0544559', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152d3655-dd0a-4491-9e6e-150a92b5e92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152d3655-dd0a-4491-9e6e-150a92b5e92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe5792b-1dd5-4362-9504-df3d8393be56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:25 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume f154b406-b1ea-4bf9-aeca-c726a0544559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f154b406-b1ea-4bf9-aeca-c726a0544559', 'volume_size': 1}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738 1073741824" returned: 0 in 0.712s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:25 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738
Nov 02 10:24:25 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (98716afa-e0ea-44ea-a5e3-3af2d88a70cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d63d84-2784-4482-b24a-4dcfbd667cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d63d84-2784-4482-b24a-4dcfbd667cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462343929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34cbfc76-9088-4416-af68-dd9fcbf30ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:26Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:25 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ae628f-f72a-4ade-8c4c-f53c50cead3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ae628f-f72a-4ade-8c4c-f53c50cead3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086aeb57-b061-4547-b49a-3f637052a53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086aeb57-b061-4547-b49a-3f637052a53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34cbfc76-9088-4416-af68-dd9fcbf30ad6', 'volume_name': 'volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9611f451-a725-4ca5-8c48-4bef649e3efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9611f451-a725-4ca5-8c48-4bef649e3efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e1665b-a468-45b9-bc2f-1d5b2b0f1f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:25 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume 34cbfc76-9088-4416-af68-dd9fcbf30ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6', 'volume_size': 1}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-19920799-505e-47ae-89c6-9fc2ac582a95-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738" returned: 0 in 0.435s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-140415856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0031215b-44ad-42b1-b34a-1f9cd17a8b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:25Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Creating volume 0031215b-44ad-42b1-b34a-1f9cd17a8b8c {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:25 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ae894c-b71f-425e-aa1d-e101641ef645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98487206-211c-487c-9d8d-35d25b595738', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:25 devstack sudo[107056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c 1073741824
Nov 02 10:24:25 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720a2fe9-adf2-4072-bb17-305356de7788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-19920799-505e-47ae-89c6-9fc2ac582a95-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:25 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Volume volume-98487206-211c-487c-9d8d-35d25b595738 (98487206-211c-487c-9d8d-35d25b595738): created successfully
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720a2fe9-adf2-4072-bb17-305356de7788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Flow 'volume_create_manager' (aff577dd-df26-4695-babb-722729d89c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:25 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-788aa89e-3977-4fae-a06d-bbc810878f41 tempest-ProjectReaderTests-28749545 None] Created volume successfully.
Nov 02 10:24:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-quobyte-19920799-505e-47ae-89c6-9fc2ac582a95" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-19920799-505e-47ae-89c6-9fc2ac582a95" acquired by "delete_volume" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2466c3d-4228-4ea7-8e5a-58d18ad1b990]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:26 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95
Nov 02 10:24:26 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (91ddb8cc-fe0e-44cb-bcfc-e0615f752af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be280cb-9f78-451d-89d6-cb8c1ab7c1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be280cb-9f78-451d-89d6-cb8c1ab7c1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1458867747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffb75da-d8aa-4197-8b59-9dc9d7406abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:26Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3da114-c494-408b-9cbe-be383cdb4866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3da114-c494-408b-9cbe-be383cdb4866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d30907-215a-47fb-aec4-50611ff45f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d30907-215a-47fb-aec4-50611ff45f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cffb75da-d8aa-4197-8b59-9dc9d7406abe', 'volume_name': 'volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e5de85-4d0a-46ae-8fa7-1e3e19db44c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e5de85-4d0a-46ae-8fa7-1e3e19db44c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20884446-1bda-45be-87cc-515f0a7ecac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:26 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume cffb75da-d8aa-4197-8b59-9dc9d7406abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe', 'volume_size': 1}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:26 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c 1073741824" returned: 0 in 0.719s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:26 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95" returned: 0 in 0.539s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:26 devstack sudo[107066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c
Nov 02 10:24:26 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:26 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95
Nov 02 10:24:26 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:26 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (1249f436-1ec3-4ea0-a72f-5444a968f7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585a966c-3838-420d-8752-65d64af0f64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:26 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-19920799-505e-47ae-89c6-9fc2ac582a95" returned: 0 in 0.385s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c" returned: 0 in 0.426s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.685s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-630650473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f154b406-b1ea-4bf9-aeca-c726a0544559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:25Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Creating volume f154b406-b1ea-4bf9-aeca-c726a0544559 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:27 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-19920799-505e-47ae-89c6-9fc2ac582a95" released by "delete_volume" :: held 1.040s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585a966c-3838-420d-8752-65d64af0f64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919585041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1158b6c-8c8a-4c67-b2be-f987c5108f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:27Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:27 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559 1073741824
Nov 02 10:24:27 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0a6c03-684c-4759-b8ab-a2b049003a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0a6c03-684c-4759-b8ab-a2b049003a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d0605b-2b41-4012-8c14-10a3f01a9462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d0605b-2b41-4012-8c14-10a3f01a9462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1158b6c-8c8a-4c67-b2be-f987c5108f7f', 'volume_name': 'volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd3dda7-3724-4ca0-a81b-1314bcd76e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd3dda7-3724-4ca0-a81b-1314bcd76e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcd5b0f-14fc-4909-a6ea-a21586c3c888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:27 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume d1158b6c-8c8a-4c67-b2be-f987c5108f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f', 'volume_size': 1}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27af7340-46c6-4715-9940-41b3e6f6f331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9ff2e8-faf8-4fe8-bcaa-c17b0a00d52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:27 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c (0031215b-44ad-42b1-b34a-1f9cd17a8b8c): created successfully
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9ff2e8-faf8-4fe8-bcaa-c17b0a00d52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (e8ac412b-1acd-43df-ab8f-73ab472581da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:27 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d6d0af52-71ba-4aaf-aab5-a58abac39e05 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created volume successfully.
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created reservations ['3c90853e-0498-4a37-a1f4-d5d3dc2c4b2f', '8ddab66b-366a-4df0-afa3-fb92eab20b1a', 'daa50a61-4e7b-4ec3-915c-8fc147466aa1', '265fd133-ffce-44e0-b02a-8a0513b390a9'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:27 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:27 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:27 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559 1073741824" returned: 0 in 0.583s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:27 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.382s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:27 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Deleted volume successfully.
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-eca5957f-fbde-4755-9d2e-9c70d79c3f5b tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-19920799-505e-47ae-89c6-9fc2ac582a95-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:27 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559
Nov 02 10:24:27 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:28 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559" returned: 0 in 0.299s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.212s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462343929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34cbfc76-9088-4416-af68-dd9fcbf30ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:26Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Creating volume 34cbfc76-9088-4416-af68-dd9fcbf30ad6 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:28 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe5792b-1dd5-4362-9504-df3d8393be56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f154b406-b1ea-4bf9-aeca-c726a0544559', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c18205-7111-425c-a343-a1c31fadd28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:28 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6 1073741824
Nov 02 10:24:28 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:28 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume volume-f154b406-b1ea-4bf9-aeca-c726a0544559 (f154b406-b1ea-4bf9-aeca-c726a0544559): created successfully
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c18205-7111-425c-a343-a1c31fadd28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (617a887d-12cc-4ba3-bee9-b512f5cfd85c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:28 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-900d14c9-496b-4b94-a107-a3ce6976596d tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created volume successfully.
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-quobyte-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a" acquired by "delete_volume" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[123969b7-18c2-4bb5-b0fb-935b7afa0609]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:28 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a
Nov 02 10:24:28 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:28 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6 1073741824" returned: 0 in 0.578s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:28 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a" returned: 0 in 0.470s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:28 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6
Nov 02 10:24:28 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:28 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a
Nov 02 10:24:28 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:28 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6" returned: 0 in 0.268s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.415s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1458867747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cffb75da-d8aa-4197-8b59-9dc9d7406abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:26Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Creating volume cffb75da-d8aa-4197-8b59-9dc9d7406abe {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:28 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:28 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a" returned: 0 in 0.292s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:28 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe 1073741824
Nov 02 10:24:28 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e1665b-a468-45b9-bc2f-1d5b2b0f1f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb2efb2-6290-403b-bd06-68a29dc7eef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a" released by "delete_volume" :: held 0.835s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:29 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6 (34cbfc76-9088-4416-af68-dd9fcbf30ad6): created successfully
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb2efb2-6290-403b-bd06-68a29dc7eef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (98716afa-e0ea-44ea-a5e3-3af2d88a70cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:29 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e8dd692b-b73f-4cc5-a317-57c968772904 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created volume successfully.
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created reservations ['a7ba1fff-dec6-4016-891f-f4e83437e8b3', '1912561a-f46d-4ef2-8530-1b8b4a47130e', 'f6d68487-17d9-480b-a420-162bed1d9526', '5af2d833-e236-4b88-b0d1-ac88c32f7460'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:29 devstack sudo[107109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:29 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:29 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe 1073741824" returned: 0 in 0.469s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:29 devstack sudo[107111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe
Nov 02 10:24:29 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:29 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.280s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:29 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Deleted volume successfully.
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b37b0a2-aed4-45c0-bf0b-eb930643ab9d tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-1a226d4a-49a8-43e0-ba5c-aa5b0b07148a-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:29 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe" returned: 0 in 0.286s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.211s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] Creating offline snapshot aaae6420-41d6-485d-8b6f-e8f6c2dd365c of volume 98487206-211c-487c-9d8d-35d25b595738 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20884446-1bda-45be-87cc-515f0a7ecac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5c1adc-8c78-4fff-9b21-dcf16aea0ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c279a55b-a6b5-4706-94fd-b6d6e8456e27]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:29 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe (cffb75da-d8aa-4197-8b59-9dc9d7406abe): created successfully
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5c1adc-8c78-4fff-9b21-dcf16aea0ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (91ddb8cc-fe0e-44cb-bcfc-e0615f752af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:29 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b0541e8f-704e-44f2-9448-20982f50ae3b tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created volume successfully.
Nov 02 10:24:29 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738
Nov 02 10:24:29 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:30 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738" returned: 0 in 0.396s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:30 devstack sudo[107120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c 1G
Nov 02 10:24:30 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-quobyte-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a500a24f-9a4a-4ce0-9123-2db4a12dd26a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:30 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11
Nov 02 10:24:30 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:30 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c 1G" returned: 0 in 0.542s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98487206-211c-487c-9d8d-35d25b595738 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:30 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98487206-211c-487c-9d8d-35d25b595738 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c
Nov 02 10:24:30 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:30 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11" returned: 0 in 0.475s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:31 devstack sudo[107133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11
Nov 02 10:24:31 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:31 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98487206-211c-487c-9d8d-35d25b595738 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c" returned: 0 in 0.352s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:31 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c is being set with open permissions: ugo+rw
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:31 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c
Nov 02 10:24:31 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:31 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11" returned: 0 in 0.304s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11" released by "delete_volume" :: held 0.839s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created reservations ['9e59cf7a-5ffe-4d40-9d28-01a43795c518', '087f98c4-ce71-4eda-b662-7d962c05445d', 'cf236098-7e8c-4f86-8384-3459f284b5a8', 'c8558c10-ee38-4d2b-88e0-7cc761533589'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:31 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c" returned: 0 in 0.297s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:31 devstack sudo[107143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.info
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:31 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:31 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:31 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-34f72afc-4b0f-42b2-8dfb-70ff43a51f82-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-34f72afc-4b0f-42b2-8dfb-70ff43a51f82-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-quobyte-34f72afc-4b0f-42b2-8dfb-70ff43a51f82" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-34f72afc-4b0f-42b2-8dfb-70ff43a51f82" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[093fffde-2c9e-430f-9c31-ebfdea62219d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:31 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.info" returned: 0 in 0.357s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:31 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.info is being set with open permissions: ugo+rw
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:31 devstack sudo[107150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.info
Nov 02 10:24:31 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:31 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.373s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:31 devstack sudo[107148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82
Nov 02 10:24:31 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:31 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Deleted volume successfully.
Nov 02 10:24:31 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ee53cd2b-8654-41c5-a7bd-19c8101543e0 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-afd701f0-5bfe-4e27-a4fa-e5fe2bd73b11-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:32 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.info" returned: 0 in 0.308s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.035s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:32 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919585041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1158b6c-8c8a-4c67-b2be-f987c5108f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c83e893f09465d800d8ed4eac54e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:27Z,use_quota=True,user_id='6b2226ee3fd14701875ee4eea038512b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Creating volume d1158b6c-8c8a-4c67-b2be-f987c5108f7f {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:32 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82" returned: 0 in 0.431s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:32 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f 1073741824
Nov 02 10:24:32 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:32 devstack sudo[107158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82
Nov 02 10:24:32 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ba591a40-5498-4d3a-b562-577b4118636b tempest-ProjectReaderTests-28749545 None] Create snapshot completed successfully
Nov 02 10:24:32 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:32 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34f72afc-4b0f-42b2-8dfb-70ff43a51f82" returned: 0 in 0.334s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-34f72afc-4b0f-42b2-8dfb-70ff43a51f82" released by "delete_volume" :: held 0.856s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created reservations ['78f7a6f9-a2b5-4c6d-af44-46b440b63234', '5eff21a3-34ad-44f3-85af-13fa6468c41b', 'b7280806-0924-41c3-96cd-cc09ce2973f4', '283f8491-ad1c-46cb-9b7e-d4e6450028e6'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:32 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:32 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-f120f70b-edaf-41e1-9074-0fd43db1ea74-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:32 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f 1073741824" returned: 0 in 0.750s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:32 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-f120f70b-edaf-41e1-9074-0fd43db1ea74-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:33 devstack sudo[107168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f
Nov 02 10:24:33 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-quobyte-f120f70b-edaf-41e1-9074-0fd43db1ea74" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-f120f70b-edaf-41e1-9074-0fd43db1ea74" acquired by "delete_volume" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9390667f-bfb5-4b15-95b7-52c80730c6cc]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:33 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.545s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:33 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Deleted volume successfully.
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-aaae6420-41d6-485d-8b6f-e8f6c2dd365c-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:33 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:33 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f" returned: 0 in 0.340s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:33 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Lock "cinder-aaae6420-41d6-485d-8b6f-e8f6c2dd365c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-98487206-211c-487c-9d8d-35d25b595738" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcd5b0f-14fc-4909-a6ea-a21586c3c888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c49353-7597-406c-b199-8c42da3161dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-59162215-ccb6-4de1-9096-21f750da7c07 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-34f72afc-4b0f-42b2-8dfb-70ff43a51f82-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:33 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Volume volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f (d1158b6c-8c8a-4c67-b2be-f987c5108f7f): created successfully
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c49353-7597-406c-b199-8c42da3161dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Flow 'volume_create_manager' (1249f436-1ec3-4ea0-a72f-5444a968f7c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-98487206-211c-487c-9d8d-35d25b595738" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-aaae6420-41d6-485d-8b6f-e8f6c2dd365c" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:33 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d60347a3-a1a3-4bc8-8479-dfe1802d8e36 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created volume successfully.
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-aaae6420-41d6-485d-8b6f-e8f6c2dd365c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Deleting offline snapshot aaae6420-41d6-485d-8b6f-e8f6c2dd365c of volume 98487206-211c-487c-9d8d-35d25b595738 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] snapshot_file for this snap is: volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe882a8-0223-4c62-8fbd-14643d855bb4]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:33 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c
Nov 02 10:24:33 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-d1158b6c-8c8a-4c67-b2be-f987c5108f7f-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:33 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74" returned: 0 in 0.537s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-d1158b6c-8c8a-4c67-b2be-f987c5108f7f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:33 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74
Nov 02 10:24:33 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-quobyte-d1158b6c-8c8a-4c67-b2be-f987c5108f7f" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-d1158b6c-8c8a-4c67-b2be-f987c5108f7f" acquired by "delete_volume" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc2d91f-f40f-4eae-8f82-20ffecf255e7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:33 devstack sudo[107181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f
Nov 02 10:24:33 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:33 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c" returned: 0 in 0.474s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98487206-211c-487c-9d8d-35d25b595738(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[192b8344-9df5-4f83-ae44-557cf274b412]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:34 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f120f70b-edaf-41e1-9074-0fd43db1ea74" returned: 0 in 0.392s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-f120f70b-edaf-41e1-9074-0fd43db1ea74" released by "delete_volume" :: held 1.000s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created reservations ['6915b672-33ec-4dca-b815-106bd7ffac22', '801a1b71-def0-49a5-aaaa-0e354d756c93', '9fc62aa5-4bf4-4c1f-9de2-1ea98180cb9d', '9ba26886-b4ba-4228-a76a-94615ce41dcf'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:34 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738
Nov 02 10:24:34 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:34 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f" returned: 0 in 0.486s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:34 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:34 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:34 devstack sudo[107195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f
Nov 02 10:24:34 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:34 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738" returned: 0 in 0.490s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:34 devstack sudo[107202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c
Nov 02 10:24:34 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:34 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-d1158b6c-8c8a-4c67-b2be-f987c5108f7f" returned: 0 in 0.327s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:34 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.383s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-d1158b6c-8c8a-4c67-b2be-f987c5108f7f" released by "delete_volume" :: held 0.875s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:34 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Deleted volume successfully.
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-dc4ed2a6-7417-4975-9765-ba9f2a1e9458 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-f120f70b-edaf-41e1-9074-0fd43db1ea74-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created reservations ['cf63d79c-7974-4e9b-b0e3-1cfa2adb72e6', '1266d4a6-9d5b-4c69-a113-3a344be723c7', '1f7c5484-ae66-4f4d-958b-d2eb51277688', '57318e9c-c0f7-499f-bd52-5077a0f57a08'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:34 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:34 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:35 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c" returned: 0 in 0.497s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:35 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c
Nov 02 10:24:35 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:35 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.369s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:35 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Deleted volume successfully.
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-66fe27bb-a918-4d19-ab7c-9fa47e1b3f96 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-d1158b6c-8c8a-4c67-b2be-f987c5108f7f-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-cffb75da-d8aa-4197-8b59-9dc9d7406abe-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-cffb75da-d8aa-4197-8b59-9dc9d7406abe-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "cinder-quobyte-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0" acquired by "delete_volume" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-quobyte-cffb75da-d8aa-4197-8b59-9dc9d7406abe" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b718ed97-453e-419c-a445-a2529cc3c55f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:35 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-cffb75da-d8aa-4197-8b59-9dc9d7406abe" acquired by "delete_volume" :: waited 0.038s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738.aaae6420-41d6-485d-8b6f-e8f6c2dd365c" returned: 0 in 0.417s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c481c7de-e1ba-4267-a17f-75c9776e0d16]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-aaae6420-41d6-485d-8b6f-e8f6c2dd365c" released by "_delete_snapshot" :: held 2.045s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-98487206-211c-487c-9d8d-35d25b595738" released by "delete_snapshot" :: held 2.090s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:35 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0
Nov 02 10:24:35 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:35 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe
Nov 02 10:24:35 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Created reservations ['42fc62ee-e88e-44f8-8b9f-a2c78c94b6d8', 'a2bed3ba-80ef-4899-8385-6095d889b3f3', 'bc57089c-5fd9-4ed1-a365-26dbc1dd26a5', '5c336bd5-20ec-452f-9687-8b8341b1da82'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:35 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Delete snapshot completed successfully.
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bed4ee9-ba4e-47dc-be25-451e87019977 tempest-ProjectReaderTests-28749545 None] Lock "cinder-aaae6420-41d6-485d-8b6f-e8f6c2dd365c-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:35 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0" returned: 0 in 0.534s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:35 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0
Nov 02 10:24:35 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:36 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe" returned: 0 in 0.597s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:36 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe
Nov 02 10:24:36 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:36 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0" returned: 0 in 0.311s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-quobyte-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0" released by "delete_volume" :: held 0.915s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Created reservations ['2e459d88-0faf-476b-a6e4-d6334485a027', '9fe13746-6db6-4108-8f06-c07768f45a97', 'b265c50c-463c-43c9-9fd4-ce646345e201', 'e8e70731-ed18-4acd-be11-1e9e9484c5de'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:36 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-cffb75da-d8aa-4197-8b59-9dc9d7406abe" returned: 0 in 0.274s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-cffb75da-d8aa-4197-8b59-9dc9d7406abe" released by "delete_volume" :: held 0.956s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created reservations ['f1826ae3-c660-4574-8e4f-d900fe742215', 'b57cb1f6-c43e-43c1-8947-2f8025e59f0d', '9f7c6a8b-6637-44c7-9238-8e64bfe187a4', 'ade83f9e-7b29-4b22-9a47-0a272494501a'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:36 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:36 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-98487206-211c-487c-9d8d-35d25b595738-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Lock "cinder-98487206-211c-487c-9d8d-35d25b595738-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:36 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-98487206-211c-487c-9d8d-35d25b595738" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:36 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:36 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.315s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Deleted volume successfully.
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-98487206-211c-487c-9d8d-35d25b595738" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8eae82c2-d6f7-4b6c-8aed-765f4cdab9a3 tempest-CreateVolumesFromSourceVolumeTest-466854516 None] Lock "cinder-e224c9cc-07f7-41a4-9514-9e1b8f5fdfe0-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaa9fe3-76da-450a-94a6-e6d879db9165]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:37 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738
Nov 02 10:24:37 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:37 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.313s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:37 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Deleted volume successfully.
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4d911940-e1fc-4eea-8006-05bbc2477ac9 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-cffb75da-d8aa-4197-8b59-9dc9d7406abe-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:37 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738" returned: 0 in 0.431s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:37 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738
Nov 02 10:24:37 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-34cbfc76-9088-4416-af68-dd9fcbf30ad6-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-34cbfc76-9088-4416-af68-dd9fcbf30ad6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:37 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-98487206-211c-487c-9d8d-35d25b595738" returned: 0 in 0.341s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-quobyte-34cbfc76-9088-4416-af68-dd9fcbf30ad6" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-98487206-211c-487c-9d8d-35d25b595738" released by "delete_volume" :: held 0.887s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-34cbfc76-9088-4416-af68-dd9fcbf30ad6" acquired by "delete_volume" :: waited 0.048s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[19428727-90be-407a-bf21-777276a7d1a2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Created reservations ['74392a71-7651-4a20-98da-0eb155ef205e', '55592812-664f-4389-b582-a81b0f428fe5', 'f68d3d2d-668e-42bc-b031-874d3d79ca49', 'e17b22f2-72f0-472b-8dfd-d1c5a7eea972'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:37 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6
Nov 02 10:24:37 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:38 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:38 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:38 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6" returned: 0 in 0.543s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:38 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.371s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:38 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Deleted volume successfully.
Nov 02 10:24:38 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6
Nov 02 10:24:38 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-9fed2ee2-d7fa-4c45-bb1f-f2a671b8ba65 tempest-ProjectReaderTests-28749545 None] Lock "cinder-98487206-211c-487c-9d8d-35d25b595738-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:38 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-34cbfc76-9088-4416-af68-dd9fcbf30ad6" returned: 0 in 0.358s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-34cbfc76-9088-4416-af68-dd9fcbf30ad6" released by "delete_volume" :: held 0.976s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created reservations ['35cb7963-9f35-4c4a-8c0a-33f8e1bd0033', '9f0d3cdb-6685-4df4-94b2-8770b3cf41df', '52ea703f-7013-49fd-9fd9-764f37bdff75', 'e0989f2b-13c3-451e-8135-38264e938b25'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:38 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:38 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:39 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.342s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:39 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Deleted volume successfully.
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b2ee7ab2-e342-445e-b166-3388a9d6fb22 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-34cbfc76-9088-4416-af68-dd9fcbf30ad6-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Flow 'volume_create_manager' (ccc7b8e3-d55b-4af4-a757-3f287b89f808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d2fdc8-3700-4269-9ea2-c71d8d8da67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d2fdc8-3700-4269-9ea2-c71d8d8da67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-110395862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c0ab19-a70c-489c-a67f-b062a3eb8bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756b2e74d6814b3195170363664c9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:39Z,use_quota=True,user_id='f37cbe15323a4a49b313cf81737e8cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d7629a-9a94-4b5c-9236-4488678f11c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d7629a-9a94-4b5c-9236-4488678f11c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10b1a41-4d6e-4827-a17b-25681bd87805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10b1a41-4d6e-4827-a17b-25681bd87805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c0ab19-a70c-489c-a67f-b062a3eb8bfa', 'volume_name': 'volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959ea49-0316-4b25-ba02-7642873f3c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959ea49-0316-4b25-ba02-7642873f3c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197096c4-339b-47f9-9552-81bf3a341646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:39 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Volume 68c0ab19-a70c-489c-a67f-b062a3eb8bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa', 'volume_size': 1}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-110395862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c0ab19-a70c-489c-a67f-b062a3eb8bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756b2e74d6814b3195170363664c9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:39Z,use_quota=True,user_id='f37cbe15323a4a49b313cf81737e8cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Creating volume 68c0ab19-a70c-489c-a67f-b062a3eb8bfa {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:39 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:39 devstack sudo[107261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa 1073741824
Nov 02 10:24:39 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-f154b406-b1ea-4bf9-aeca-c726a0544559-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:39 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-f154b406-b1ea-4bf9-aeca-c726a0544559-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-quobyte-f154b406-b1ea-4bf9-aeca-c726a0544559" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-f154b406-b1ea-4bf9-aeca-c726a0544559" acquired by "delete_volume" :: waited 0.029s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[af27330c-3002-433f-bcb8-435b18166ce1]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:40 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559
Nov 02 10:24:40 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:40 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa 1073741824" returned: 0 in 0.750s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:40 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa
Nov 02 10:24:40 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:40 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559" returned: 0 in 0.541s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:40 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559
Nov 02 10:24:40 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:40 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa" returned: 0 in 0.347s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197096c4-339b-47f9-9552-81bf3a341646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ba469f-331b-452a-b5f2-9a1a5951cf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:40 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Volume volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa (68c0ab19-a70c-489c-a67f-b062a3eb8bfa): created successfully
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ba469f-331b-452a-b5f2-9a1a5951cf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Flow 'volume_create_manager' (ccc7b8e3-d55b-4af4-a757-3f287b89f808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:40 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4c122c91-93a0-44b3-ad0a-523fd6a8c8ae tempest-ProjectReaderTests-28749545 None] Created volume successfully.
Nov 02 10:24:40 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f154b406-b1ea-4bf9-aeca-c726a0544559" returned: 0 in 0.305s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:40 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-f154b406-b1ea-4bf9-aeca-c726a0544559" released by "delete_volume" :: held 0.905s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created reservations ['01a5d8bd-3763-45b3-86d3-d4db2ccbf825', '83597bb8-2eb1-4b3b-a7b7-074800f14304', 'e1928462-493e-40a5-b30d-3a7d3efd2a20', 'ae3db3d0-6219-4c21-a400-59734385dc13'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:41 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:41 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-0031215b-44ad-42b1-b34a-1f9cd17a8b8c-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-0031215b-44ad-42b1-b34a-1f9cd17a8b8c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-quobyte-0031215b-44ad-42b1-b34a-1f9cd17a8b8c" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-0031215b-44ad-42b1-b34a-1f9cd17a8b8c" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ee8e3f-d7c5-4d44-9532-019ddaa2fe0e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:41 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.318s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Deleted volume successfully.
Nov 02 10:24:41 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c
Nov 02 10:24:41 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-afd7e97b-75e2-4dd0-806e-12c46bd3f1e8 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-f154b406-b1ea-4bf9-aeca-c726a0544559-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:41 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c" returned: 0 in 0.512s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:41 devstack sudo[107289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c
Nov 02 10:24:41 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] Creating offline snapshot 86828f98-2ceb-4cc9-8744-f4a157ab7933 of volume 68c0ab19-a70c-489c-a67f-b062a3eb8bfa {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3a2fd4-e03a-496a-8a82-7b1cee60a2c5]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:42 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa
Nov 02 10:24:42 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:42 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-0031215b-44ad-42b1-b34a-1f9cd17a8b8c" returned: 0 in 0.342s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-0031215b-44ad-42b1-b34a-1f9cd17a8b8c" released by "delete_volume" :: held 0.906s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created reservations ['0a5893ec-452b-4fdc-8b66-8c6de72b87a2', 'f93fd9a7-d2fb-418e-a27f-4e4d6f2a4463', 'f5563367-b626-4a82-931c-0711c71a884c', '8e27a3be-eb35-40b7-9c0a-133bd4479295'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:42 devstack sudo[107296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:42 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-1134e43e-7545-4917-8af3-a34f8ecb048b-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-1134e43e-7545-4917-8af3-a34f8ecb048b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-quobyte-2a06d19c-6cad-460a-bda6-7ddd294e8e11" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:42 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa" returned: 0 in 0.511s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-2a06d19c-6cad-460a-bda6-7ddd294e8e11" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-quobyte-1134e43e-7545-4917-8af3-a34f8ecb048b" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:42 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933 1G
Nov 02 10:24:42 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-1134e43e-7545-4917-8af3-a34f8ecb048b" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Deleting offline snapshot 1134e43e-7545-4917-8af3-a34f8ecb048b of volume 2a06d19c-6cad-460a-bda6-7ddd294e8e11 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] snapshot_file for this snap is: volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5c7978-0b01-4ded-b928-ff039e8e6398]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:42 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.341s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:42 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Deleted volume successfully.
Nov 02 10:24:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d888a9df-660c-4c01-955e-e8fcaa2f317c tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-0031215b-44ad-42b1-b34a-1f9cd17a8b8c-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:42 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b
Nov 02 10:24:42 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:43 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933 1G" returned: 0 in 0.648s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:43 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b" returned: 0 in 0.536s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:24:43 devstack sudo[107312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933
Nov 02 10:24:43 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[046b27a3-8125-4e2a-927d-3b253a2f75c1]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:43 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11
Nov 02 10:24:43 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:43 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933" returned: 0 in 0.380s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:43 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933 is being set with open permissions: ugo+rw
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:43 devstack sudo[107319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933
Nov 02 10:24:43 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:43 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11" returned: 0 in 0.514s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:43 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b
Nov 02 10:24:43 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:43 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933" returned: 0 in 0.352s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:43 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.info
Nov 02 10:24:43 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:44 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b" returned: 0 in 0.412s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:44 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b
Nov 02 10:24:44 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:44 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.info" returned: 0 in 0.307s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:44 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.info is being set with open permissions: ugo+rw
Nov 02 10:24:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:44 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.info
Nov 02 10:24:44 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:44 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11.1134e43e-7545-4917-8af3-a34f8ecb048b" returned: 0 in 0.326s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-1134e43e-7545-4917-8af3-a34f8ecb048b" released by "_delete_snapshot" :: held 1.959s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-2a06d19c-6cad-460a-bda6-7ddd294e8e11" released by "delete_snapshot" :: held 2.015s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:44 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.info" returned: 0 in 0.330s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6401d6e6-5496-4452-8538-ea7f211c17ab tempest-ProjectReaderTests-28749545 None] Create snapshot completed successfully
Nov 02 10:24:44 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created reservations ['509e9db3-b0c1-46c5-bdd0-9b4183981ff5', '12fc37fe-9c0b-412e-86f6-8107258f539e', '27f927f4-d9ef-47cf-aba0-45ed761faac0', '3fcab75a-8ced-4737-98d5-3922bac6bc8a'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Delete snapshot completed successfully.
Nov 02 10:24:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5d891ec6-ee24-491b-ac96-751d9e9d33d5 tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-1134e43e-7545-4917-8af3-a34f8ecb048b-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-86828f98-2ceb-4cc9-8744-f4a157ab7933-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Lock "cinder-86828f98-2ceb-4cc9-8744-f4a157ab7933-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-68c0ab19-a70c-489c-a67f-b062a3eb8bfa" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-68c0ab19-a70c-489c-a67f-b062a3eb8bfa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-86828f98-2ceb-4cc9-8744-f4a157ab7933" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-86828f98-2ceb-4cc9-8744-f4a157ab7933" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Deleting offline snapshot 86828f98-2ceb-4cc9-8744-f4a157ab7933 of volume 68c0ab19-a70c-489c-a67f-b062a3eb8bfa {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] snapshot_file for this snap is: volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d1bd5f-f9e8-4de7-bf4a-90dc16f79cbe]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:45 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933
Nov 02 10:24:45 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:45 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933" returned: 0 in 0.420s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-2a06d19c-6cad-460a-bda6-7ddd294e8e11-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa3a164-bb74-4b0f-bb0f-26e86a87adfe]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-2a06d19c-6cad-460a-bda6-7ddd294e8e11-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "cinder-quobyte-2a06d19c-6cad-460a-bda6-7ddd294e8e11" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-2a06d19c-6cad-460a-bda6-7ddd294e8e11" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:45 devstack sudo[107345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa
Nov 02 10:24:45 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4f0dfa-0b2d-473e-8b01-390ea280b7f5]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:46 devstack sudo[107347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11
Nov 02 10:24:46 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:46 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa" returned: 0 in 0.527s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:46 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933
Nov 02 10:24:46 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:46 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11" returned: 0 in 0.489s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:46 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11
Nov 02 10:24:46 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:46 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933" returned: 0 in 0.481s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:46 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2a06d19c-6cad-460a-bda6-7ddd294e8e11" returned: 0 in 0.356s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:46 devstack sudo[107363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933
Nov 02 10:24:46 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-quobyte-2a06d19c-6cad-460a-bda6-7ddd294e8e11" released by "delete_volume" :: held 0.953s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=177,cinder:UPDATE=262,cinder:INSERT=80,cinder:DELETE=23 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=207,cinder:UPDATE=264,cinder:DELETE=25,cinder:INSERT=62 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Created reservations ['b923df3f-fa6e-46d9-9cac-768ad8a9be02', '76ee7524-c26c-4e32-9e91-e59ee6e22883', '29a7f858-5b4f-4c42-b9c6-0291cff6d9da', '272d1639-7ee8-4a7b-b44b-c84471c5c70e'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:47 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:47 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:47 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa.86828f98-2ceb-4cc9-8744-f4a157ab7933" returned: 0 in 0.373s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-86828f98-2ceb-4cc9-8744-f4a157ab7933" released by "_delete_snapshot" :: held 1.944s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-68c0ab19-a70c-489c-a67f-b062a3eb8bfa" released by "delete_snapshot" :: held 1.973s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Created reservations ['f761d73e-62c4-4c43-8b25-2e60a74bfcaf', '21b0a03c-150c-48bc-a3cc-8942afc556ba', '7a59dc5c-7af4-4db8-847c-08b823273814', '44c67060-be04-4cf6-8964-330404ccb739'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Delete snapshot completed successfully.
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fd217564-e0f1-4cc2-90c9-46416210b7a5 tempest-ProjectReaderTests-28749545 None] Lock "cinder-86828f98-2ceb-4cc9-8744-f4a157ab7933-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:47 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.349s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Deleted volume successfully.
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5274242f-38af-4953-a100-a36df829fa8e tempest-CreateVolumesFromSnapshotTest-1899573904 None] Lock "cinder-2a06d19c-6cad-460a-bda6-7ddd294e8e11-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (0d9aa4bf-f461-4fbb-a29b-dd3d888bed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09894ff-e339-46e8-9876-6ab392726a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09894ff-e339-46e8-9876-6ab392726a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010070719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a505d85f-54e4-4075-bf48-3055f37e0d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:48Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d3a183-c528-4d88-aee9-87ff846d995d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d3a183-c528-4d88-aee9-87ff846d995d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3841403b-8c78-4d09-8a73-5be6837bbb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3841403b-8c78-4d09-8a73-5be6837bbb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a505d85f-54e4-4075-bf48-3055f37e0d06', 'volume_name': 'volume-a505d85f-54e4-4075-bf48-3055f37e0d06', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa400a3-6a0e-46ee-b8bd-313f161a2918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa400a3-6a0e-46ee-b8bd-313f161a2918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1587cfef-bffc-4940-bbf8-c5b2d4dd8e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:47 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Volume a505d85f-54e4-4075-bf48-3055f37e0d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a505d85f-54e4-4075-bf48-3055f37e0d06', 'volume_size': 1}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010070719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a505d85f-54e4-4075-bf48-3055f37e0d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:48Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Creating volume a505d85f-54e4-4075-bf48-3055f37e0d06 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:47 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:47 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06 1073741824
Nov 02 10:24:47 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-68c0ab19-a70c-489c-a67f-b062a3eb8bfa-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Lock "cinder-68c0ab19-a70c-489c-a67f-b062a3eb8bfa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:48 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06 1073741824" returned: 0 in 0.573s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-68c0ab19-a70c-489c-a67f-b062a3eb8bfa" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-68c0ab19-a70c-489c-a67f-b062a3eb8bfa" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:48 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b01a103-c21e-4176-a216-8b2132530739]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:48 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06
Nov 02 10:24:48 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:48 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa
Nov 02 10:24:48 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:48 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06" returned: 0 in 0.428s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1587cfef-bffc-4940-bbf8-c5b2d4dd8e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a505d85f-54e4-4075-bf48-3055f37e0d06', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce665303-f0fe-4b98-a8fd-9b5542faf72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:49 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Volume volume-a505d85f-54e4-4075-bf48-3055f37e0d06 (a505d85f-54e4-4075-bf48-3055f37e0d06): created successfully
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce665303-f0fe-4b98-a8fd-9b5542faf72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (0d9aa4bf-f461-4fbb-a29b-dd3d888bed55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:49 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-cc1cb9ed-112f-4719-81fc-4058697a6532 tempest-ProjectMemberTests-1929280023 None] Created volume successfully.
Nov 02 10:24:49 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa" returned: 0 in 0.502s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:49 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa
Nov 02 10:24:49 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:49 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-68c0ab19-a70c-489c-a67f-b062a3eb8bfa" returned: 0 in 0.268s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-68c0ab19-a70c-489c-a67f-b062a3eb8bfa" released by "delete_volume" :: held 0.867s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Created reservations ['d24ba258-04fc-4fa3-a902-79a04ca9db4f', 'f5e5e27e-eca4-4502-8990-4e1e421830c9', 'd3b94243-664d-4b73-acb2-0ec897bc2a91', 'a2d5450c-62fd-4b2a-9e81-ebaf2856f103'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:49 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:49 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:49 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.304s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:49 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Deleted volume successfully.
Nov 02 10:24:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b281adb-f42f-4a6a-9789-15feac440350 tempest-ProjectReaderTests-28749545 None] Lock "cinder-68c0ab19-a70c-489c-a67f-b062a3eb8bfa-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Flow 'volume_create_manager' (864e7f9f-465b-46b7-a203-67f58abcc4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e445600-6b93-4505-bf42-a838ed8f79a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e445600-6b93-4505-bf42-a838ed8f79a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376618454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f887efd-8a8e-4d6b-8fd2-ecf749deb9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756b2e74d6814b3195170363664c9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:50Z,use_quota=True,user_id='f37cbe15323a4a49b313cf81737e8cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d306756-36d0-4240-8b76-9909fca46d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d306756-36d0-4240-8b76-9909fca46d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe9e4e9-14dc-4f59-8cc2-bfb3f18afc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe9e4e9-14dc-4f59-8cc2-bfb3f18afc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f887efd-8a8e-4d6b-8fd2-ecf749deb9db', 'volume_name': 'volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c3add4-cdcf-435f-9eb3-9ac8a6570cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c3add4-cdcf-435f-9eb3-9ac8a6570cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace4f396-7bc2-4961-8cd0-93cc5172818b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:50 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Volume 5f887efd-8a8e-4d6b-8fd2-ecf749deb9db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db', 'volume_size': 1}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376618454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f887efd-8a8e-4d6b-8fd2-ecf749deb9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756b2e74d6814b3195170363664c9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:50Z,use_quota=True,user_id='f37cbe15323a4a49b313cf81737e8cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Creating volume 5f887efd-8a8e-4d6b-8fd2-ecf749deb9db {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:50 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:50 devstack sudo[107390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db 1073741824
Nov 02 10:24:50 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:51 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db 1073741824" returned: 0 in 0.679s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:51 devstack sudo[107396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db
Nov 02 10:24:51 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:51 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db" returned: 0 in 0.256s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.544s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace4f396-7bc2-4961-8cd0-93cc5172818b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccdcd68-1420-4eac-9587-12c467d5a3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] Creating offline snapshot 4dad6c9d-297a-45f7-97d9-614a10eab151 of volume a505d85f-54e4-4075-bf48-3055f37e0d06 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:24:51 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Volume volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db (5f887efd-8a8e-4d6b-8fd2-ecf749deb9db): created successfully
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccdcd68-1420-4eac-9587-12c467d5a3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Flow 'volume_create_manager' (864e7f9f-465b-46b7-a203-67f58abcc4a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e88020-16ef-4614-8d87-4b9d2b5f671f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:51 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e2765ed7-1333-4318-9982-f5ff12eb289b tempest-ProjectReaderTests-28749545 None] Created volume successfully.
Nov 02 10:24:51 devstack sudo[107399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06
Nov 02 10:24:51 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:51 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06" returned: 0 in 0.490s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:51 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151 1G
Nov 02 10:24:51 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Flow 'volume_create_manager' (ddca95cf-ca36-48cf-9497-aaffcdf1f4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034574b2-606e-4615-a6bd-9ed9ef81e8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034574b2-606e-4615-a6bd-9ed9ef81e8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-760093565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d88931-b831-4635-abf1-31999a828c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c38af0079ac4f139848640f674c719e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:52Z,use_quota=True,user_id='1b84c97748c343dfac374a6f58ba5d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ae8a4a-10c5-4566-a661-9855448589b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ae8a4a-10c5-4566-a661-9855448589b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276db47a-a237-4642-b69c-8e004d598b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276db47a-a237-4642-b69c-8e004d598b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d88931-b831-4635-abf1-31999a828c32', 'volume_name': 'volume-57d88931-b831-4635-abf1-31999a828c32', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07f27a2-3873-4bfa-8c29-05468eeb6458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07f27a2-3873-4bfa-8c29-05468eeb6458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ef9828-34d0-437b-b607-d80a1bd8c9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:52 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Volume 57d88931-b831-4635-abf1-31999a828c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d88931-b831-4635-abf1-31999a828c32', 'volume_size': 1}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:52 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151 1G" returned: 0 in 0.608s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a505d85f-54e4-4075-bf48-3055f37e0d06 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:52 devstack sudo[107410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a505d85f-54e4-4075-bf48-3055f37e0d06 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151
Nov 02 10:24:52 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:52 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a505d85f-54e4-4075-bf48-3055f37e0d06 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151" returned: 0 in 0.336s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:52 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151 is being set with open permissions: ugo+rw
Nov 02 10:24:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:52 devstack sudo[107415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151
Nov 02 10:24:52 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:53 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151" returned: 0 in 0.256s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:53 devstack sudo[107418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.info
Nov 02 10:24:53 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:53 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.info" returned: 0 in 0.291s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:53 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.info is being set with open permissions: ugo+rw
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:53 devstack sudo[107421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.info
Nov 02 10:24:53 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:53 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.info" returned: 0 in 0.275s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-760093565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d88931-b831-4635-abf1-31999a828c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c38af0079ac4f139848640f674c719e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:52Z,use_quota=True,user_id='1b84c97748c343dfac374a6f58ba5d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Creating volume 57d88931-b831-4635-abf1-31999a828c32 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:53 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:53 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 1073741824
Nov 02 10:24:53 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:53 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8a80a072-37f5-4a14-90c0-2f05039e8f96 tempest-ProjectMemberTests-1929280023 None] Create snapshot completed successfully
Nov 02 10:24:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-4dad6c9d-297a-45f7-97d9-614a10eab151-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Lock "cinder-4dad6c9d-297a-45f7-97d9-614a10eab151-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-a505d85f-54e4-4075-bf48-3055f37e0d06" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-a505d85f-54e4-4075-bf48-3055f37e0d06" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-4dad6c9d-297a-45f7-97d9-614a10eab151" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-4dad6c9d-297a-45f7-97d9-614a10eab151" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Deleting offline snapshot 4dad6c9d-297a-45f7-97d9-614a10eab151 of volume a505d85f-54e4-4075-bf48-3055f37e0d06 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] snapshot_file for this snap is: volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f5b10a-e042-4fa3-8995-8be029381abe]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:54 devstack sudo[107429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151
Nov 02 10:24:54 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:54 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 1073741824" returned: 0 in 0.694s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:54 devstack sudo[107432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32
Nov 02 10:24:54 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:54 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151" returned: 0 in 0.529s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a505d85f-54e4-4075-bf48-3055f37e0d06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b25e6a-7b0a-425d-892a-7d849695fafb]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:54 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32" returned: 0 in 0.363s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.303s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ef9828-34d0-437b-b607-d80a1bd8c9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d88931-b831-4635-abf1-31999a828c32', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa214719-0d27-46c0-92a0-9bcc35ec411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] Creating offline snapshot 66d49f40-47e7-4cfd-ba17-7c36481c6c7e of volume 5f887efd-8a8e-4d6b-8fd2-ecf749deb9db {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:24:54 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06
Nov 02 10:24:54 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:54 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Volume volume-57d88931-b831-4635-abf1-31999a828c32 (57d88931-b831-4635-abf1-31999a828c32): created successfully
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa214719-0d27-46c0-92a0-9bcc35ec411d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Flow 'volume_create_manager' (ddca95cf-ca36-48cf-9497-aaffcdf1f4bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba6701c-7aae-46b5-b3e2-a7459bccf7a7]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:55 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e551e049-1a5d-4034-9f25-7fac0e5a4274 tempest-VolumeDependencyTests-1647796620 None] Created volume successfully.
Nov 02 10:24:55 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db
Nov 02 10:24:55 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:55 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06" returned: 0 in 0.573s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:55 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151
Nov 02 10:24:55 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:55 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db" returned: 0 in 0.475s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:55 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e 1G
Nov 02 10:24:55 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Flow 'volume_create_manager' (6b428954-75db-4278-b0cc-5ca6a14408a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574b8767-de23-4acb-89ae-4db6665b7012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574b8767-de23-4acb-89ae-4db6665b7012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1817616130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7784ef-5487-4d47-a091-f1085d4f331f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3841e17cf5de4e7d90f23783426f84db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:55Z,use_quota=True,user_id='3638204dd81b4d8bbaab883e73339c08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb69963f-4087-4279-a3a9-051e57a7b94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb69963f-4087-4279-a3a9-051e57a7b94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c23d09-1d4e-4aaf-88db-84f1fb662189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c23d09-1d4e-4aaf-88db-84f1fb662189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7784ef-5487-4d47-a091-f1085d4f331f', 'volume_name': 'volume-2b7784ef-5487-4d47-a091-f1085d4f331f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b503a6-59fb-4a43-a246-8ea7766190e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b503a6-59fb-4a43-a246-8ea7766190e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d882406e-9f03-4210-b8d7-280fc79d7eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:55 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Volume 2b7784ef-5487-4d47-a091-f1085d4f331f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7784ef-5487-4d47-a091-f1085d4f331f', 'volume_size': 1}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:55 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151" returned: 0 in 0.431s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:55 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151
Nov 02 10:24:55 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:56 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06.4dad6c9d-297a-45f7-97d9-614a10eab151" returned: 0 in 0.258s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:56 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e 1G" returned: 0 in 0.559s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:56 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e
Nov 02 10:24:56 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-4dad6c9d-297a-45f7-97d9-614a10eab151" released by "_delete_snapshot" :: held 2.007s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-a505d85f-54e4-4075-bf48-3055f37e0d06" released by "delete_snapshot" :: held 2.052s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Created reservations ['ddd0febc-aa08-4edc-95df-93506c236abe', '046acb5e-164d-456d-8baf-1bdc855a1fbb', '1f04e21c-55ac-414e-b49f-4342561d18f4', '8adb686f-5a5c-4d8e-9219-679225bd5046'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:56 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Delete snapshot completed successfully.
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-6838fa7d-2020-437f-b8fe-adb62594d4de tempest-ProjectMemberTests-1929280023 None] Lock "cinder-4dad6c9d-297a-45f7-97d9-614a10eab151-delete_snapshot" released by "delete_snapshot" :: held 2.233s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:56 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e" returned: 0 in 0.300s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:56 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e is being set with open permissions: ugo+rw
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:56 devstack sudo[107470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e
Nov 02 10:24:56 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:56 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e" returned: 0 in 0.241s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:56 devstack sudo[107473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.info
Nov 02 10:24:56 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:56 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.info" returned: 0 in 0.307s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:56 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.info is being set with open permissions: ugo+rw
Nov 02 10:24:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:56 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.info
Nov 02 10:24:56 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:57 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.info" returned: 0 in 0.246s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.303s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.587s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1817616130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7784ef-5487-4d47-a091-f1085d4f331f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3841e17cf5de4e7d90f23783426f84db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:55Z,use_quota=True,user_id='3638204dd81b4d8bbaab883e73339c08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Creating volume 2b7784ef-5487-4d47-a091-f1085d4f331f {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:24:57 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:57 devstack sudo[107482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f 1073741824
Nov 02 10:24:57 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:57 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f824d1d1-fa4f-4b3f-a45d-eab09e43ed21 tempest-ProjectReaderTests-28749545 None] Create snapshot completed successfully
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-a505d85f-54e4-4075-bf48-3055f37e0d06-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Lock "cinder-a505d85f-54e4-4075-bf48-3055f37e0d06-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-a505d85f-54e4-4075-bf48-3055f37e0d06" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-a505d85f-54e4-4075-bf48-3055f37e0d06" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[746ad037-af48-4e7f-886b-301fc3364cdd]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:57 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06
Nov 02 10:24:57 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:57 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f 1073741824" returned: 0 in 0.446s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:57 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f
Nov 02 10:24:57 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:57 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06" returned: 0 in 0.451s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:57 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06
Nov 02 10:24:57 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-66d49f40-47e7-4cfd-ba17-7c36481c6c7e-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Lock "cinder-66d49f40-47e7-4cfd-ba17-7c36481c6c7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:57 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-66d49f40-47e7-4cfd-ba17-7c36481c6c7e" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:24:57 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f" returned: 0 in 0.303s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.277s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d882406e-9f03-4210-b8d7-280fc79d7eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7784ef-5487-4d47-a091-f1085d4f331f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ab0554-167f-4ea8-a32c-dce4127a6335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-66d49f40-47e7-4cfd-ba17-7c36481c6c7e" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Deleting offline snapshot 66d49f40-47e7-4cfd-ba17-7c36481c6c7e of volume 5f887efd-8a8e-4d6b-8fd2-ecf749deb9db {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] snapshot_file for this snap is: volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] Creating offline snapshot 9199167e-ae92-4d6c-919a-b0909ed06ed2 of volume 57d88931-b831-4635-abf1-31999a828c32 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:24:58 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Volume volume-2b7784ef-5487-4d47-a091-f1085d4f331f (2b7784ef-5487-4d47-a091-f1085d4f331f): created successfully
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ab0554-167f-4ea8-a32c-dce4127a6335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Flow 'volume_create_manager' (6b428954-75db-4278-b0cc-5ca6a14408a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f3635f-e564-4545-84d7-4a79877d35f5]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[96397ddf-9aeb-45ff-b0aa-220601924c9c]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:58 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-be091585-d893-4d51-aa8a-373f8648488a tempest-SnapshotDependencyTests-808217880 None] Created volume successfully.
Nov 02 10:24:58 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a505d85f-54e4-4075-bf48-3055f37e0d06" returned: 0 in 0.267s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-a505d85f-54e4-4075-bf48-3055f37e0d06" released by "delete_volume" :: held 0.804s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Created reservations ['bd255417-28a5-4331-bba6-2924eef408b3', 'b664f51e-b945-4ba6-885e-57a95b5b01e8', 'e865be11-4a14-44e9-8f14-66357a4fcdec', 'ae539959-d5ea-4011-9eba-19990cf760ca'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:58 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e
Nov 02 10:24:58 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32
Nov 02 10:24:58 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:58 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:58 devstack sudo[107506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:24:58 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:58 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e" returned: 0 in 0.464s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:24:58 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:58 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.312s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32" returned: 0 in 0.494s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c2a44b-e728-49ee-823d-ee9b77ca8b06]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:58 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Deleted volume successfully.
Nov 02 10:24:58 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2 1G
Nov 02 10:24:58 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:58 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f94bd884-0d3f-4be1-a6f4-9a45ee1f815b tempest-ProjectMemberTests-1929280023 None] Lock "cinder-a505d85f-54e4-4075-bf48-3055f37e0d06-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:58 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db
Nov 02 10:24:58 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:59 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db" returned: 0 in 0.517s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:59 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2 1G" returned: 0 in 0.553s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d88931-b831-4635-abf1-31999a828c32 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:59 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e
Nov 02 10:24:59 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:59 devstack sudo[107529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d88931-b831-4635-abf1-31999a828c32 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2
Nov 02 10:24:59 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (12fa2bb9-0a6e-4f45-aa1c-3fe15ef3bff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cc5318-35f2-4234-bee1-ae0a5bdfbfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cc5318-35f2-4234-bee1-ae0a5bdfbfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607633571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654f2b09-db06-4787-b45f-6d7816283e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:59Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b64b534-d872-40be-91e8-5298366141ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b64b534-d872-40be-91e8-5298366141ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d76ec2-10cc-4647-890e-ccbec290e27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d76ec2-10cc-4647-890e-ccbec290e27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '654f2b09-db06-4787-b45f-6d7816283e2b', 'volume_name': 'volume-654f2b09-db06-4787-b45f-6d7816283e2b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661bac92-c57c-49f2-bbd0-235371e2aa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661bac92-c57c-49f2-bbd0-235371e2aa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805e065d-c280-4e19-bfcd-efee84066068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:24:59 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Volume 654f2b09-db06-4787-b45f-6d7816283e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-654f2b09-db06-4787-b45f-6d7816283e2b', 'volume_size': 1}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:24:59 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d88931-b831-4635-abf1-31999a828c32 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2" returned: 0 in 0.330s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:59 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2 is being set with open permissions: ugo+rw
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:59 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e" returned: 0 in 0.365s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:59 devstack sudo[107538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2
Nov 02 10:24:59 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:59 devstack sudo[107539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e
Nov 02 10:24:59 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:59 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2" returned: 0 in 0.246s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:59 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db.66d49f40-47e7-4cfd-ba17-7c36481c6c7e" returned: 0 in 0.248s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-66d49f40-47e7-4cfd-ba17-7c36481c6c7e" released by "_delete_snapshot" :: held 1.754s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db" released by "delete_snapshot" :: held 1.814s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:24:59 devstack sudo[107544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.info
Nov 02 10:24:59 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Created reservations ['66168d17-8cfb-49d9-9417-73dd97f5fae1', '421aa69c-cfd1-4986-9953-42b6aa1ff230', '213fca90-5e72-46cc-8b00-0d7762a539d9', '7e426565-1343-4836-9456-a5f0eb31a3c2'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:24:59 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Delete snapshot completed successfully.
Nov 02 10:24:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-58212a3e-eada-4b8b-9f7f-98c82fd0a2e2 tempest-ProjectReaderTests-28749545 None] Lock "cinder-66d49f40-47e7-4cfd-ba17-7c36481c6c7e-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:00 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.info" returned: 0 in 0.281s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:00 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.info is being set with open permissions: ugo+rw
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:00 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.info
Nov 02 10:25:00 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Lock "cinder-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3ed7c4-a092-4489-a4b2-4b9222957056]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:00 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.info" returned: 0 in 0.255s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:00 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db
Nov 02 10:25:00 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.071s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] Creating offline snapshot a16c1d12-2998-4930-b607-97064bb7435f of volume 2b7784ef-5487-4d47-a091-f1085d4f331f {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:25:00 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fe004847-d1da-460d-8750-00f07184ac43 tempest-VolumeDependencyTests-1647796620 None] Create snapshot completed successfully
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b458b8e1-309f-4b94-b8ef-49ebf73dab1b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:00 devstack sudo[107552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f
Nov 02 10:25:00 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:00 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db" returned: 0 in 0.367s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:00 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db
Nov 02 10:25:00 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:00 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f" returned: 0 in 0.414s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:00 devstack sudo[107564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f 1G
Nov 02 10:25:00 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:00 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db" returned: 0 in 0.267s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db" released by "delete_volume" :: held 0.707s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:00 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Created reservations ['d4c60bde-3cca-4516-b869-fae8915c8da3', '1fed3d7a-1900-419d-819f-49032a9e6c55', '01a6fa33-2c34-4f37-9f8d-f927cf06c2e1', '6a9e1088-c61a-4314-bea7-b6be4b3127f0'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:01 devstack sudo[107566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:01 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:01 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.277s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:01 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Deleted volume successfully.
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-a6f45515-3bef-4775-87ee-fbb2456c38d3 tempest-ProjectReaderTests-28749545 None] Lock "cinder-5f887efd-8a8e-4d6b-8fd2-ecf749deb9db-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:01 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f 1G" returned: 0 in 0.530s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7784ef-5487-4d47-a091-f1085d4f331f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:01 devstack sudo[107574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7784ef-5487-4d47-a091-f1085d4f331f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f
Nov 02 10:25:01 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:01 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7784ef-5487-4d47-a091-f1085d4f331f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f" returned: 0 in 0.348s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:01 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f is being set with open permissions: ugo+rw
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:01 devstack sudo[107579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f
Nov 02 10:25:01 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:01 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:25:01 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f" returned: 0 in 0.304s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Flow 'volume_create_manager' (fdc05720-1b4c-4188-b83c-9e64a4066092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2b4a8d-33c2-4c8e-b1cc-0041887a2238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2b4a8d-33c2-4c8e-b1cc-0041887a2238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-970015011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff350df-d5f9-4692-a49f-118f4491c8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c38af0079ac4f139848640f674c719e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9199167e-ae92-4d6c-919a-b0909ed06ed2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:02Z,use_quota=True,user_id='1b84c97748c343dfac374a6f58ba5d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8043c605-40a6-4ba1-be26-0899c8a9da26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8043c605-40a6-4ba1-be26-0899c8a9da26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dda055e-f40c-4b3f-b008-429ea4e6a5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dda055e-f40c-4b3f-b008-429ea4e6a5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fff350df-d5f9-4692-a49f-118f4491c8c3', 'volume_name': 'volume-fff350df-d5f9-4692-a49f-118f4491c8c3', 'volume_size': 1, 'snapshot_id': '9199167e-ae92-4d6c-919a-b0909ed06ed2'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e093a333-3dbf-402c-89e8-bedd9ff7135c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e093a333-3dbf-402c-89e8-bedd9ff7135c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3202c02b-c4a9-4d8b-805e-cb287238170e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:02 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Volume fff350df-d5f9-4692-a49f-118f4491c8c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fff350df-d5f9-4692-a49f-118f4491c8c3', 'volume_size': 1, 'snapshot_id': '9199167e-ae92-4d6c-919a-b0909ed06ed2'}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Flow 'volume_create_manager' (643267df-96c1-4a29-9761-2ee8140d8407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1f36e4-8dac-4996-b03e-e33a9fb6e051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1f36e4-8dac-4996-b03e-e33a9fb6e051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963387932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47a6a62-f332-4dfa-b690-1be86685b199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756b2e74d6814b3195170363664c9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:02Z,use_quota=True,user_id='f37cbe15323a4a49b313cf81737e8cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:02 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.info
Nov 02 10:25:02 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d1d00d-5a3d-4c79-b94b-b1f4d5fb97f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d1d00d-5a3d-4c79-b94b-b1f4d5fb97f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e53f25-2057-455e-b67e-20655dc12710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e53f25-2057-455e-b67e-20655dc12710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c47a6a62-f332-4dfa-b690-1be86685b199', 'volume_name': 'volume-c47a6a62-f332-4dfa-b690-1be86685b199', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe0552e-8f43-4276-9fed-a0ecef51236c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe0552e-8f43-4276-9fed-a0ecef51236c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d59a62-ea1c-4376-974b-9e0b2da932fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:02 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Volume c47a6a62-f332-4dfa-b690-1be86685b199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c47a6a62-f332-4dfa-b690-1be86685b199', 'volume_size': 1}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:02 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.info" returned: 0 in 0.293s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:02 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.info is being set with open permissions: ugo+rw
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:02 devstack sudo[107588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.info
Nov 02 10:25:02 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:02 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.info" returned: 0 in 0.259s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.410s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607633571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654f2b09-db06-4787-b45f-6d7816283e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:24:59Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Creating volume 654f2b09-db06-4787-b45f-6d7816283e2b {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:25:02 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:25:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:02 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b 1073741824
Nov 02 10:25:02 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:02 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-01471f73-dd3c-439c-9380-8aafd0beb5e9 tempest-SnapshotDependencyTests-808217880 None] Create snapshot completed successfully
Nov 02 10:25:03 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b 1073741824" returned: 0 in 0.433s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:03 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b
Nov 02 10:25:03 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:03 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b" returned: 0 in 0.312s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.358s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "cinder-quobyte-9199167e-ae92-4d6c-919a-b0909ed06ed2-fff350df-d5f9-4692-a49f-118f4491c8c3" by "_create_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805e065d-c280-4e19-bfcd-efee84066068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654f2b09-db06-4787-b45f-6d7816283e2b', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4c1955-a001-49e7-807c-f4c29b34ac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-9199167e-ae92-4d6c-919a-b0909ed06ed2-fff350df-d5f9-4692-a49f-118f4491c8c3" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Creating volume fff350df-d5f9-4692-a49f-118f4491c8c3 from snapshot 9199167e-ae92-4d6c-919a-b0909ed06ed2 {{(pid=87014) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "cinder-quobyte-fff350df-d5f9-4692-a49f-118f4491c8c3" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:03 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Volume volume-654f2b09-db06-4787-b45f-6d7816283e2b (654f2b09-db06-4787-b45f-6d7816283e2b): created successfully
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4c1955-a001-49e7-807c-f4c29b34ac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (12fa2bb9-0a6e-4f45-aa1c-3fe15ef3bff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-fff350df-d5f9-4692-a49f-118f4491c8c3" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] snapshot: 9199167e-ae92-4d6c-919a-b0909ed06ed2, volume: fff350df-d5f9-4692-a49f-118f4491c8c3,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:03 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-a3705ce3-509a-4d7e-902b-fd0473dcb139 tempest-ProjectMemberTests-1929280023 None] Created volume successfully.
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b970b39-685d-4454-9dab-85875176b8fa]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:03 devstack sudo[107829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2
Nov 02 10:25:03 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Flow 'volume_create_manager' (979e1b36-4d24-4219-a75c-2596045b9772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac07d59-8de1-4f65-85a8-fde060128101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac07d59-8de1-4f65-85a8-fde060128101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3693ebbf-d92b-4e99-8f8f-3f734eefa209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3841e17cf5de4e7d90f23783426f84db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a16c1d12-2998-4930-b607-97064bb7435f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:04Z,use_quota=True,user_id='3638204dd81b4d8bbaab883e73339c08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0654fd56-526c-4821-bb2d-3239a3c443c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0654fd56-526c-4821-bb2d-3239a3c443c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee122c7-798e-4865-86d0-01ab9d279250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee122c7-798e-4865-86d0-01ab9d279250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3693ebbf-d92b-4e99-8f8f-3f734eefa209', 'volume_name': 'volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209', 'volume_size': 1, 'snapshot_id': 'a16c1d12-2998-4930-b607-97064bb7435f'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c8bf53-ddd6-4c99-9ce3-c16a2a995cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c8bf53-ddd6-4c99-9ce3-c16a2a995cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6caa259-a4fb-40e2-96d2-bee540cbf718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:04 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Volume 3693ebbf-d92b-4e99-8f8f-3f734eefa209: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209', 'volume_size': 1, 'snapshot_id': 'a16c1d12-2998-4930-b607-97064bb7435f'}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:04 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2" returned: 0 in 0.437s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57d88931-b831-4635-abf1-31999a828c32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc950c1-7726-43ae-810d-fb305d35a886]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:04 devstack sudo[107934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32
Nov 02 10:25:04 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:04 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32" returned: 0 in 0.417s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3 not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:25:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:04 devstack sudo[107939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3
Nov 02 10:25:04 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:07 devstack sudo[107954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:07 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:07 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.369s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:25:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:25:10 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3" returned: 0 in 5.921s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:25:10 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Converted 1024.00 MB image at 172.91 MB/s
Nov 02 10:25:10 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3 is being set with open permissions: ugo+rw
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:10 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3
Nov 02 10:25:10 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:10 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3" returned: 0 in 0.233s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-fff350df-d5f9-4692-a49f-118f4491c8c3" released by "_copy_volume_from_snapshot" :: held 7.140s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-9199167e-ae92-4d6c-919a-b0909ed06ed2-fff350df-d5f9-4692-a49f-118f4491c8c3" released by "_create_volume_from_snapshot" :: held 7.242s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.278s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.592s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963387932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47a6a62-f332-4dfa-b690-1be86685b199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756b2e74d6814b3195170363664c9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:02Z,use_quota=True,user_id='f37cbe15323a4a49b313cf81737e8cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Creating volume c47a6a62-f332-4dfa-b690-1be86685b199 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:25:10 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:10 devstack sudo[107961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199 1073741824
Nov 02 10:25:10 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3202c02b-c4a9-4d8b-805e-cb287238170e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff350df-d5f9-4692-a49f-118f4491c8c3', 'volume_size': 1, 'snapshot_id': '9199167e-ae92-4d6c-919a-b0909ed06ed2'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f574dc22-85ac-4e99-a22d-c32829fc742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:10 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Volume volume-fff350df-d5f9-4692-a49f-118f4491c8c3 (fff350df-d5f9-4692-a49f-118f4491c8c3): created successfully
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f574dc22-85ac-4e99-a22d-c32829fc742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Flow 'volume_create_manager' (fdc05720-1b4c-4188-b83c-9e64a4066092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-06d79a70-fbe2-4511-980d-4a9536bae21f tempest-VolumeDependencyTests-1647796620 None] Created volume successfully.
Nov 02 10:25:11 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199 1073741824" returned: 0 in 0.393s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:11 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199
Nov 02 10:25:11 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:11 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199" returned: 0 in 0.253s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.476s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "cinder-quobyte-a16c1d12-2998-4930-b607-97064bb7435f-3693ebbf-d92b-4e99-8f8f-3f734eefa209" by "_create_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "cinder-9199167e-ae92-4d6c-919a-b0909ed06ed2-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-a16c1d12-2998-4930-b607-97064bb7435f-3693ebbf-d92b-4e99-8f8f-3f734eefa209" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Creating volume 3693ebbf-d92b-4e99-8f8f-3f734eefa209 from snapshot a16c1d12-2998-4930-b607-97064bb7435f {{(pid=87014) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "cinder-quobyte-3693ebbf-d92b-4e99-8f8f-3f734eefa209" by "_copy_volume_from_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d59a62-ea1c-4376-974b-9e0b2da932fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c47a6a62-f332-4dfa-b690-1be86685b199', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3865c0-b270-4fbc-a3cd-4786afa0b8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-3693ebbf-d92b-4e99-8f8f-3f734eefa209" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] snapshot: a16c1d12-2998-4930-b607-97064bb7435f, volume: 3693ebbf-d92b-4e99-8f8f-3f734eefa209,  {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-9199167e-ae92-4d6c-919a-b0909ed06ed2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "cinder-quobyte-57d88931-b831-4635-abf1-31999a828c32" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:11 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Volume volume-c47a6a62-f332-4dfa-b690-1be86685b199 (c47a6a62-f332-4dfa-b690-1be86685b199): created successfully
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3865c0-b270-4fbc-a3cd-4786afa0b8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Flow 'volume_create_manager' (643267df-96c1-4a29-9761-2ee8140d8407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-57d88931-b831-4635-abf1-31999a828c32" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "cinder-quobyte-9199167e-ae92-4d6c-919a-b0909ed06ed2" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:11 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9b8547e6-7c55-4ba3-834f-084bc2a8b2ba tempest-ProjectReaderTests-28749545 None] Created volume successfully.
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1810291a-65a6-4200-9a7a-540d29dbdfcc]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-9199167e-ae92-4d6c-919a-b0909ed06ed2" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Deleting offline snapshot 9199167e-ae92-4d6c-919a-b0909ed06ed2 of volume 57d88931-b831-4635-abf1-31999a828c32 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] snapshot_file for this snap is: volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e475962-3684-4828-8076-723a75b40c55]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:11 devstack sudo[107969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f
Nov 02 10:25:11 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:11 devstack sudo[107970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2
Nov 02 10:25:11 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:12 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f" returned: 0 in 0.408s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b7784ef-5487-4d47-a091-f1085d4f331f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:25:12 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26acf34-b8c6-473a-a7bc-da834972c65a]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2" returned: 0 in 0.400s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57d88931-b831-4635-abf1-31999a828c32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[787b5da4-a87a-48d5-bff3-4ad4b769ae8b]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:12 devstack sudo[107979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f
Nov 02 10:25:12 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:12 devstack sudo[107980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32
Nov 02 10:25:12 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:12 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f" returned: 0 in 0.386s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Creating direct copy from snapshot {{(pid=87014) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG cinder.utils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Path /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209 not found in is_blk_device check {{(pid=87014) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:12 devstack sudo[107988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209
Nov 02 10:25:12 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:12 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32" returned: 0 in 0.562s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:12 devstack sudo[107993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2
Nov 02 10:25:12 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:13 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2" returned: 0 in 0.521s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:13 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2
Nov 02 10:25:13 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:13 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32.9199167e-ae92-4d6c-919a-b0909ed06ed2" returned: 0 in 0.574s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-9199167e-ae92-4d6c-919a-b0909ed06ed2" released by "_delete_snapshot" :: held 2.214s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-57d88931-b831-4635-abf1-31999a828c32" released by "delete_snapshot" :: held 2.257s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:14 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Created reservations ['16985c2d-f97f-4452-83d7-71eeeed7ff33', '79b09ff1-11ca-473a-bb9e-60d743bf0760', '7e2a2eed-27f5-4e23-a1b0-fdb45b937a78', '497d127b-4101-4f2d-82d0-15825c69906c'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:14 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Delete snapshot completed successfully.
Nov 02 10:25:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3bba23de-bfa2-4d91-900a-94d5d8b2d925 tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-9199167e-ae92-4d6c-919a-b0909ed06ed2-delete_snapshot" released by "delete_snapshot" :: held 2.578s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "cinder-57d88931-b831-4635-abf1-31999a828c32-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-57d88931-b831-4635-abf1-31999a828c32-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "cinder-quobyte-57d88931-b831-4635-abf1-31999a828c32" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-57d88931-b831-4635-abf1-31999a828c32" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:15 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[92016fc3-4947-40e7-a240-4cfa02aa3385]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:15 devstack sudo[108011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32
Nov 02 10:25:15 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:15 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32" returned: 0 in 0.894s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:16 devstack sudo[108016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32
Nov 02 10:25:16 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:16 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-57d88931-b831-4635-abf1-31999a828c32" returned: 0 in 0.394s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-57d88931-b831-4635-abf1-31999a828c32" released by "delete_volume" :: held 1.453s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:16 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Created reservations ['62d0b444-6b82-446a-8b4b-e4fae49302a4', 'a83665ca-34b0-49ad-bc56-3a0e34546a31', '6143fcac-e818-4976-9823-d0cf7cb3a9c9', 'fdfb566c-ed20-4b9c-a7fc-d84a5ecb7aca'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:16 devstack sudo[108019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:16 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:17 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.522s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:17 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:17 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Deleted volume successfully.
Nov 02 10:25:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8ec3d282-33da-4e5f-bbed-57bbcec28d8a tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-57d88931-b831-4635-abf1-31999a828c32-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "cinder-fff350df-d5f9-4692-a49f-118f4491c8c3-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-fff350df-d5f9-4692-a49f-118f4491c8c3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "cinder-quobyte-fff350df-d5f9-4692-a49f-118f4491c8c3" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:17 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-fff350df-d5f9-4692-a49f-118f4491c8c3" acquired by "delete_volume" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:17 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c11dbe7-a159-406d-ba5c-8e6f0352a11e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:17 devstack sudo[108022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3
Nov 02 10:25:17 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:18 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3" returned: 0 in 0.540s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:18 devstack sudo[108027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3
Nov 02 10:25:18 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:18 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-fff350df-d5f9-4692-a49f-118f4491c8c3" returned: 0 in 0.629s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:18 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-quobyte-fff350df-d5f9-4692-a49f-118f4491c8c3" released by "delete_volume" :: held 1.267s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:18 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Created reservations ['88bb578a-7572-4e4a-b3df-f1ee387d8bb4', 'ff27a5db-8216-4d8f-8a90-d85db9d5138a', '68c75a51-a606-4d55-af9b-c7bc58e18b5c', 'a2155aae-30ba-433b-9625-7456815654d9'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:19 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:19 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:19 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209" returned: 0 in 6.656s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG cinder.image.image_utils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209 {{(pid=87014) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 02 10:25:19 devstack cinder-volume[87014]: INFO cinder.image.image_utils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Converted 1024.00 MB image at 153.81 MB/s
Nov 02 10:25:19 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209 is being set with open permissions: ugo+rw
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:19 devstack sudo[108033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209
Nov 02 10:25:19 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:19 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.311s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Deleted volume successfully.
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d8e1ddf9-a30e-4324-804d-accad9fab396 tempest-VolumeDependencyTests-1647796620 None] Lock "cinder-fff350df-d5f9-4692-a49f-118f4491c8c3-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:19 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209" returned: 0 in 0.248s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-3693ebbf-d92b-4e99-8f8f-3f734eefa209" released by "_copy_volume_from_snapshot" :: held 7.820s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-a16c1d12-2998-4930-b607-97064bb7435f-3693ebbf-d92b-4e99-8f8f-3f734eefa209" released by "_create_volume_from_snapshot" :: held 7.901s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.924s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.911s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] Creating offline snapshot dd30f872-36df-48e1-a7be-e4f30d6cd2d4 of volume 654f2b09-db06-4787-b45f-6d7816283e2b {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6caa259-a4fb-40e2-96d2-bee540cbf718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209', 'volume_size': 1, 'snapshot_id': 'a16c1d12-2998-4930-b607-97064bb7435f'}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e527df-25c4-4954-bb81-8a85f65980a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[94748208-ab4d-47fa-b381-dbd944fdcc73]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:19 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Volume volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209 (3693ebbf-d92b-4e99-8f8f-3f734eefa209): created successfully
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e527df-25c4-4954-bb81-8a85f65980a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Flow 'volume_create_manager' (979e1b36-4d24-4219-a75c-2596045b9772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:19 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3d3fbb63-b84b-4be7-89b6-aa43a529f670 tempest-SnapshotDependencyTests-808217880 None] Created volume successfully.
Nov 02 10:25:19 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b
Nov 02 10:25:19 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:19 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b" returned: 0 in 0.382s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:19 devstack sudo[108042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4 1G
Nov 02 10:25:19 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "cinder-a16c1d12-2998-4930-b607-97064bb7435f-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:20 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4 1G" returned: 0 in 0.521s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-654f2b09-db06-4787-b45f-6d7816283e2b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-a16c1d12-2998-4930-b607-97064bb7435f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "cinder-quobyte-2b7784ef-5487-4d47-a091-f1085d4f331f" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:20 devstack sudo[108048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-654f2b09-db06-4787-b45f-6d7816283e2b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4
Nov 02 10:25:20 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-2b7784ef-5487-4d47-a091-f1085d4f331f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "cinder-quobyte-a16c1d12-2998-4930-b607-97064bb7435f" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-a16c1d12-2998-4930-b607-97064bb7435f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Deleting offline snapshot a16c1d12-2998-4930-b607-97064bb7435f of volume 2b7784ef-5487-4d47-a091-f1085d4f331f {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] snapshot_file for this snap is: volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d6c291-58c5-4c38-8696-d0d4649ec621]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:20 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f
Nov 02 10:25:20 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:20 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-654f2b09-db06-4787-b45f-6d7816283e2b -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4" returned: 0 in 0.390s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:20 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4 is being set with open permissions: ugo+rw
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:20 devstack sudo[108057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4
Nov 02 10:25:20 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:20 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f" returned: 0 in 0.424s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b7784ef-5487-4d47-a091-f1085d4f331f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[b613f953-3c97-4735-bf6b-d1e8f2d9f972]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:21 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4" returned: 0 in 0.287s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:21 devstack sudo[108063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f
Nov 02 10:25:21 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:21 devstack sudo[108066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.info
Nov 02 10:25:21 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:21 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.info" returned: 0 in 0.287s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:21 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.info is being set with open permissions: ugo+rw
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:21 devstack sudo[108071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.info
Nov 02 10:25:21 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:21 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f" returned: 0 in 0.604s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:21 devstack sudo[108074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f
Nov 02 10:25:21 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:21 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.info" returned: 0 in 0.356s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.895s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] Creating offline snapshot a222d1d2-bf15-4966-a598-cdc295761dd9 of volume c47a6a62-f332-4dfa-b690-1be86685b199 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:25:21 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-de03c3f3-d29f-4cae-9eb0-d21ccc3f226b tempest-ProjectMemberTests-1929280023 None] Create snapshot completed successfully
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[0953fa05-87da-48ed-a87b-82f2acfff144]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:22 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199
Nov 02 10:25:22 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:22 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f" returned: 0 in 0.551s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:22 devstack sudo[108205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f
Nov 02 10:25:22 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-dd30f872-36df-48e1-a7be-e4f30d6cd2d4-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:22 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Lock "cinder-dd30f872-36df-48e1-a7be-e4f30d6cd2d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-654f2b09-db06-4787-b45f-6d7816283e2b" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199" returned: 0 in 0.525s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-654f2b09-db06-4787-b45f-6d7816283e2b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-dd30f872-36df-48e1-a7be-e4f30d6cd2d4" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:22 devstack sudo[108210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9 1G
Nov 02 10:25:22 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-dd30f872-36df-48e1-a7be-e4f30d6cd2d4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Deleting offline snapshot dd30f872-36df-48e1-a7be-e4f30d6cd2d4 of volume 654f2b09-db06-4787-b45f-6d7816283e2b {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] snapshot_file for this snap is: volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:25:22 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[74efe791-b192-43ef-a381-800c5afa4385]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f.a16c1d12-2998-4930-b607-97064bb7435f" returned: 0 in 0.392s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-a16c1d12-2998-4930-b607-97064bb7435f" released by "_delete_snapshot" :: held 2.122s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-2b7784ef-5487-4d47-a091-f1085d4f331f" released by "delete_snapshot" :: held 2.151s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:22 devstack sudo[108213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4
Nov 02 10:25:22 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Created reservations ['097bdfd3-ce55-4760-a3b8-70e8a61ce739', '2faa99c5-8386-4785-80c7-f6d186bac541', '73e4abe3-e16f-4abf-8306-738ddf851861', '7fea4f0a-da1c-4107-876b-f156a3202d23'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Delete snapshot completed successfully.
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2f96066f-cea3-4b49-a399-e64a3d3c5e7f tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-a16c1d12-2998-4930-b607-97064bb7435f-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:22 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4" returned: 0 in 0.432s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-654f2b09-db06-4787-b45f-6d7816283e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:25:22 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9 1G" returned: 0 in 0.544s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c47a6a62-f332-4dfa-b690-1be86685b199 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf985ef-a9c9-49bf-91b8-378bf32e92e9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:23 devstack sudo[108223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c47a6a62-f332-4dfa-b690-1be86685b199 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9
Nov 02 10:25:23 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:23 devstack sudo[108224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b
Nov 02 10:25:23 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:23 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c47a6a62-f332-4dfa-b690-1be86685b199 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9" returned: 0 in 0.347s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:23 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9 is being set with open permissions: ugo+rw
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:23 devstack sudo[108232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9
Nov 02 10:25:23 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:23 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b" returned: 0 in 0.411s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:23 devstack sudo[108235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4
Nov 02 10:25:23 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:23 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9" returned: 0 in 0.300s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "cinder-2b7784ef-5487-4d47-a091-f1085d4f331f-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-2b7784ef-5487-4d47-a091-f1085d4f331f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:23 devstack sudo[108240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.info
Nov 02 10:25:23 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "cinder-quobyte-2b7784ef-5487-4d47-a091-f1085d4f331f" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-2b7784ef-5487-4d47-a091-f1085d4f331f" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:23 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd7b85-6897-4b96-a9cb-a8456e7be935]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4" returned: 0 in 0.398s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:23 devstack sudo[108245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4
Nov 02 10:25:23 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:23 devstack sudo[108244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f
Nov 02 10:25:23 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:23 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.info" returned: 0 in 0.287s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:23 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.info is being set with open permissions: ugo+rw
Nov 02 10:25:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:23 devstack sudo[108249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.info
Nov 02 10:25:24 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:24 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b.dd30f872-36df-48e1-a7be-e4f30d6cd2d4" returned: 0 in 0.255s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-dd30f872-36df-48e1-a7be-e4f30d6cd2d4" released by "_delete_snapshot" :: held 1.628s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-654f2b09-db06-4787-b45f-6d7816283e2b" released by "delete_snapshot" :: held 1.656s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Created reservations ['deac0fd4-0bc4-4d91-bca3-e899c1f66a4b', 'f647493f-065d-4407-ae5f-1351c35d89ef', '250887a3-72b7-4aad-bc06-99810648d49d', 'c1697b94-9547-4ef8-93e1-ce0d9cee4c13'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:24 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f" returned: 0 in 0.397s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:24 devstack sudo[108256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f
Nov 02 10:25:24 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:24 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.info" returned: 0 in 0.269s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.442s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:24 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Delete snapshot completed successfully.
Nov 02 10:25:24 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f98ef059-01a1-474f-8871-8312fd238754 tempest-ProjectReaderTests-28749545 None] Create snapshot completed successfully
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d32ec4ad-2e35-4308-9f26-e926d5b477bb tempest-ProjectMemberTests-1929280023 None] Lock "cinder-dd30f872-36df-48e1-a7be-e4f30d6cd2d4-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:24 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-2b7784ef-5487-4d47-a091-f1085d4f331f" returned: 0 in 0.276s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-2b7784ef-5487-4d47-a091-f1085d4f331f" released by "delete_volume" :: held 0.743s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-a222d1d2-bf15-4966-a598-cdc295761dd9-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Lock "cinder-a222d1d2-bf15-4966-a598-cdc295761dd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-c47a6a62-f332-4dfa-b690-1be86685b199" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-c47a6a62-f332-4dfa-b690-1be86685b199" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-a222d1d2-bf15-4966-a598-cdc295761dd9" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Created reservations ['c388dd5a-6425-487b-a148-bfb59986e5aa', 'db8b4799-8bfc-4267-b703-c47cefff67d9', '85e26c16-f16b-47c6-a22e-5d35fd90efda', '1d0fde2f-e1ef-47cc-a42c-41c3b1a37990'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-a222d1d2-bf15-4966-a598-cdc295761dd9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Deleting offline snapshot a222d1d2-bf15-4966-a598-cdc295761dd9 of volume c47a6a62-f332-4dfa-b690-1be86685b199 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] snapshot_file for this snap is: volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0fc5e6-86ef-49e4-8e54-7577176497da]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-654f2b09-db06-4787-b45f-6d7816283e2b-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Lock "cinder-654f2b09-db06-4787-b45f-6d7816283e2b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:24 devstack sudo[108260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:24 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:24 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9
Nov 02 10:25:24 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-654f2b09-db06-4787-b45f-6d7816283e2b" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-654f2b09-db06-4787-b45f-6d7816283e2b" acquired by "delete_volume" :: waited 0.031s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:24 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "cinder-3693ebbf-d92b-4e99-8f8f-3f734eefa209-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9219d97b-c29b-48d5-b8e2-ee8c126d3b73]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-3693ebbf-d92b-4e99-8f8f-3f734eefa209-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "cinder-quobyte-3693ebbf-d92b-4e99-8f8f-3f734eefa209" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-3693ebbf-d92b-4e99-8f8f-3f734eefa209" acquired by "delete_volume" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:25 devstack sudo[108263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38d6bc8-3047-46df-a817-8fb75df419f2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:25 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:25 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.359s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:25 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Deleted volume successfully.
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d55e39ca-c9ca-4203-a64c-d7e617b37d15 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-2b7784ef-5487-4d47-a091-f1085d4f331f-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:25 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9" returned: 0 in 0.621s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c47a6a62-f332-4dfa-b690-1be86685b199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:25:25 devstack sudo[108266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209
Nov 02 10:25:25 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[185283ca-4c3e-4190-abbf-cae6dfbc4635]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:25 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b" returned: 0 in 0.504s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:25 devstack sudo[108271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199
Nov 02 10:25:25 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:25 devstack sudo[108275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b
Nov 02 10:25:25 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:25 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209" returned: 0 in 0.531s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:25 devstack sudo[108281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209
Nov 02 10:25:25 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:25 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-654f2b09-db06-4787-b45f-6d7816283e2b" returned: 0 in 0.283s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:25 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-654f2b09-db06-4787-b45f-6d7816283e2b" released by "delete_volume" :: held 0.903s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199" returned: 0 in 0.493s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:25 devstack sudo[108287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9
Nov 02 10:25:25 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Created reservations ['1f9faa6f-434c-4930-b6e5-a7eedded59fd', 'abeb882d-5408-44a3-922d-d4f244031766', '3d9d16e0-3766-4732-9fc9-9fbfc92af8f8', '195702e9-cf8d-450d-b576-3244dc5c75fd'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:25 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3693ebbf-d92b-4e99-8f8f-3f734eefa209" returned: 0 in 0.264s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:25 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-quobyte-3693ebbf-d92b-4e99-8f8f-3f734eefa209" released by "delete_volume" :: held 0.856s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:26 devstack sudo[108290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:26 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Created reservations ['206f4cdb-659f-44e1-a58c-2fb62ac8e422', 'a9fdb7e1-df0e-490c-b2b0-40f241994bf0', '245be858-d8af-4acf-9908-8040b03373b9', '5f45a585-6f49-4963-8ce8-6e7b17293c79'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:26 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:26 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:26 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9" returned: 0 in 0.389s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:26 devstack sudo[108298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9
Nov 02 10:25:26 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:26 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.289s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:26 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Deleted volume successfully.
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-5e9c6f14-06e1-46f8-8315-73d7587adf4d tempest-ProjectMemberTests-1929280023 None] Lock "cinder-654f2b09-db06-4787-b45f-6d7816283e2b-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:26 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.269s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:26 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Deleted volume successfully.
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fb2fda9d-7abf-4045-b124-53c0fb9fc906 tempest-SnapshotDependencyTests-808217880 None] Lock "cinder-3693ebbf-d92b-4e99-8f8f-3f734eefa209-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:26 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199.a222d1d2-bf15-4966-a598-cdc295761dd9" returned: 0 in 0.258s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-a222d1d2-bf15-4966-a598-cdc295761dd9" released by "_delete_snapshot" :: held 1.895s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-c47a6a62-f332-4dfa-b690-1be86685b199" released by "delete_snapshot" :: held 1.932s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Created reservations ['a45e5826-c188-4e3d-b7c3-4f870875bbf5', '6c7c5007-a7b8-46b4-9ba6-0e97194d6445', '18ed6859-1b64-4124-8b2c-67167861bbd5', 'eea99196-b888-4107-91b2-1a1c5cc48548'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:26 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Delete snapshot completed successfully.
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d2768b71-316d-4c1d-b389-e1ef4e6b6e4d tempest-ProjectReaderTests-28749545 None] Lock "cinder-a222d1d2-bf15-4966-a598-cdc295761dd9-delete_snapshot" released by "delete_snapshot" :: held 2.117s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-c47a6a62-f332-4dfa-b690-1be86685b199-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Lock "cinder-c47a6a62-f332-4dfa-b690-1be86685b199-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-c47a6a62-f332-4dfa-b690-1be86685b199" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-c47a6a62-f332-4dfa-b690-1be86685b199" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf6623a-5a7f-4425-ad3a-737f77b15166]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:26 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:26 devstack sudo[108303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199
Nov 02 10:25:26 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:27 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199" returned: 0 in 0.433s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:27 devstack sudo[108308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199
Nov 02 10:25:27 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:27 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-c47a6a62-f332-4dfa-b690-1be86685b199" returned: 0 in 0.369s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-c47a6a62-f332-4dfa-b690-1be86685b199" released by "delete_volume" :: held 0.892s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Created reservations ['f4c268b7-5d96-410e-8d0c-69bb2c285614', '7928d194-b939-4d4a-a007-7431ffbebbaf', 'a79bdd05-5752-4813-b821-8ac0593871bb', 'a2da4e1d-b5ab-44c8-bb83-ab3d477c0f55'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:27 devstack sudo[108312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:27 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (849f62f0-5cd4-4c36-aa50-d43fce5b1b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371942f7-c844-4eb1-88ee-2539bd10f875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:27 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371942f7-c844-4eb1-88ee-2539bd10f875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535964814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e247c31f-4fd9-4156-91da-b250210d03b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:28Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdad9d71-d2cf-440a-a2c4-c3c8a0d14033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdad9d71-d2cf-440a-a2c4-c3c8a0d14033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d69be5-2f70-45b4-a80d-e400a36e5ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d69be5-2f70-45b4-a80d-e400a36e5ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e247c31f-4fd9-4156-91da-b250210d03b5', 'volume_name': 'volume-e247c31f-4fd9-4156-91da-b250210d03b5', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca1bbe-0996-4e90-9fd3-5a37fc116785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca1bbe-0996-4e90-9fd3-5a37fc116785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3037031e-d151-41be-901e-3003614912b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:28 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Volume e247c31f-4fd9-4156-91da-b250210d03b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e247c31f-4fd9-4156-91da-b250210d03b5', 'volume_size': 1}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535964814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e247c31f-4fd9-4156-91da-b250210d03b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:28Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Creating volume e247c31f-4fd9-4156-91da-b250210d03b5 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:25:28 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:28 devstack sudo[108314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5 1073741824
Nov 02 10:25:28 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:28 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.333s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:28 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Deleted volume successfully.
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-2cabbcaf-e1fe-41f8-a749-919708ada271 tempest-ProjectReaderTests-28749545 None] Lock "cinder-c47a6a62-f332-4dfa-b690-1be86685b199-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Flow 'volume_create_manager' (d87cde04-c35f-403e-8b97-3e711b1b61e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09855d0b-6b84-467e-863c-4abf7d7360b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09855d0b-6b84-467e-863c-4abf7d7360b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107641912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a047b2a5-e7e6-449e-a231-06907f637589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756b2e74d6814b3195170363664c9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:28Z,use_quota=True,user_id='f37cbe15323a4a49b313cf81737e8cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05a378d-055d-42f3-836b-fb59356fb3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05a378d-055d-42f3-836b-fb59356fb3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846f14c7-d14b-4c46-af93-483f54d45df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846f14c7-d14b-4c46-af93-483f54d45df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a047b2a5-e7e6-449e-a231-06907f637589', 'volume_name': 'volume-a047b2a5-e7e6-449e-a231-06907f637589', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:28 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2515b9da-b70a-49f2-aaf2-ce9c1993e360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2515b9da-b70a-49f2-aaf2-ce9c1993e360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11abb502-e2fd-477b-86f1-f93304046b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:28 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Volume a047b2a5-e7e6-449e-a231-06907f637589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a047b2a5-e7e6-449e-a231-06907f637589', 'volume_size': 1}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5 1073741824" returned: 0 in 0.661s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:28 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:28 devstack sudo[108321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5
Nov 02 10:25:28 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:29 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5" returned: 0 in 0.296s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.358s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107641912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a047b2a5-e7e6-449e-a231-06907f637589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756b2e74d6814b3195170363664c9a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:28Z,use_quota=True,user_id='f37cbe15323a4a49b313cf81737e8cd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Creating volume a047b2a5-e7e6-449e-a231-06907f637589 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:25:29 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3037031e-d151-41be-901e-3003614912b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e247c31f-4fd9-4156-91da-b250210d03b5', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:29 devstack sudo[108325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589 1073741824
Nov 02 10:25:29 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3119b4fb-45f5-4db9-a05a-520f4af30696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:29 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Volume volume-e247c31f-4fd9-4156-91da-b250210d03b5 (e247c31f-4fd9-4156-91da-b250210d03b5): created successfully
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3119b4fb-45f5-4db9-a05a-520f4af30696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (849f62f0-5cd4-4c36-aa50-d43fce5b1b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:29 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-67eb4716-b4a1-496d-9a8b-4242775fe904 tempest-ProjectMemberTests-1929280023 None] Created volume successfully.
Nov 02 10:25:29 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589 1073741824" returned: 0 in 0.560s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:29 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:29 devstack sudo[108332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589
Nov 02 10:25:29 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:30 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589" returned: 0 in 0.374s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.096s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] Creating offline snapshot 2c0f64d4-08a0-4314-b621-678f833f409c of volume e247c31f-4fd9-4156-91da-b250210d03b5 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11abb502-e2fd-477b-86f1-f93304046b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a047b2a5-e7e6-449e-a231-06907f637589', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7465e8-8f5a-4481-b94d-7bf2d43aac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c445d9-cacd-4a1f-8844-0e0b64c6c43e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:30 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Volume volume-a047b2a5-e7e6-449e-a231-06907f637589 (a047b2a5-e7e6-449e-a231-06907f637589): created successfully
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7465e8-8f5a-4481-b94d-7bf2d43aac3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Flow 'volume_create_manager' (d87cde04-c35f-403e-8b97-3e711b1b61e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:30 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b9cc11cc-c259-4210-a3ff-920ec7497920 tempest-ProjectReaderTests-28749545 None] Created volume successfully.
Nov 02 10:25:30 devstack sudo[108335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5
Nov 02 10:25:30 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:30 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5" returned: 0 in 0.439s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:30 devstack sudo[108340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c 1G
Nov 02 10:25:30 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:30 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:31 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c 1G" returned: 0 in 0.550s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e247c31f-4fd9-4156-91da-b250210d03b5 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:31 devstack sudo[108346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e247c31f-4fd9-4156-91da-b250210d03b5 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c
Nov 02 10:25:31 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:31 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e247c31f-4fd9-4156-91da-b250210d03b5 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c" returned: 0 in 0.302s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:31 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c is being set with open permissions: ugo+rw
Nov 02 10:25:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:31 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c
Nov 02 10:25:31 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:31 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c" returned: 0 in 0.286s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:31 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:31 devstack sudo[108354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.info
Nov 02 10:25:31 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:32 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.info" returned: 0 in 0.282s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:32 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.info is being set with open permissions: ugo+rw
Nov 02 10:25:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:32 devstack sudo[108357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.info
Nov 02 10:25:32 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:32 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.info" returned: 0 in 0.243s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.431s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:32 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] Creating offline snapshot ed9f21c7-375a-49dd-aaf7-96f95dc88ebe of volume a047b2a5-e7e6-449e-a231-06907f637589 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:25:32 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-2046ac3d-2f65-4dbf-b934-f2978fb573a6 tempest-ProjectMemberTests-1929280023 None] Create snapshot completed successfully
Nov 02 10:25:32 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3050d4dc-d4d3-439c-acc8-b17cc1484115]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:32 devstack sudo[108360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589
Nov 02 10:25:32 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:32 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589" returned: 0 in 0.458s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:32 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:32 devstack sudo[108366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe 1G
Nov 02 10:25:32 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-2c0f64d4-08a0-4314-b621-678f833f409c-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-2c0f64d4-08a0-4314-b621-678f833f409c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-e247c31f-4fd9-4156-91da-b250210d03b5" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-e247c31f-4fd9-4156-91da-b250210d03b5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-2c0f64d4-08a0-4314-b621-678f833f409c" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-2c0f64d4-08a0-4314-b621-678f833f409c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Deleting offline snapshot 2c0f64d4-08a0-4314-b621-678f833f409c of volume e247c31f-4fd9-4156-91da-b250210d03b5 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] snapshot_file for this snap is: volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6e06d9-e373-4d2a-b0fd-941c00c9e46f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:33 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe 1G" returned: 0 in 0.492s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a047b2a5-e7e6-449e-a231-06907f637589 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:33 devstack sudo[108374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a047b2a5-e7e6-449e-a231-06907f637589 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe
Nov 02 10:25:33 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:33 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c
Nov 02 10:25:33 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:33 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c" returned: 0 in 0.405s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e247c31f-4fd9-4156-91da-b250210d03b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:25:33 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a047b2a5-e7e6-449e-a231-06907f637589 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe" returned: 0 in 0.378s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:33 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe is being set with open permissions: ugo+rw
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1568b909-c466-44ef-90cb-202f2c1f9a06]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:33 devstack sudo[108384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe
Nov 02 10:25:33 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:33 devstack sudo[108385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5
Nov 02 10:25:33 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:33 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:33 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe" returned: 0 in 0.256s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:34 devstack sudo[108389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.info
Nov 02 10:25:34 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:34 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5" returned: 0 in 0.421s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:34 devstack sudo[108394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c
Nov 02 10:25:34 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:34 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.info" returned: 0 in 0.287s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:34 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.info is being set with open permissions: ugo+rw
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:34 devstack sudo[108397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.info
Nov 02 10:25:34 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:34 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c" returned: 0 in 0.399s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:34 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.info" returned: 0 in 0.276s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:34 devstack sudo[108404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c
Nov 02 10:25:34 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:34 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-13a5374b-231b-4704-b589-2889583fcd19 tempest-ProjectReaderTests-28749545 None] Create snapshot completed successfully
Nov 02 10:25:34 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5.2c0f64d4-08a0-4314-b621-678f833f409c" returned: 0 in 0.260s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-2c0f64d4-08a0-4314-b621-678f833f409c" released by "_delete_snapshot" :: held 1.598s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-e247c31f-4fd9-4156-91da-b250210d03b5" released by "delete_snapshot" :: held 1.623s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Created reservations ['a8d57cde-4cad-49e9-8018-ab27f5ac2cbf', '4882f0d4-c4bc-40dc-9657-ffff818019fe', '2911199f-b11e-4a15-a971-bcd0e7fde335', '999cac4d-aed2-4972-968f-05d2365aa3fe'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:34 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Delete snapshot completed successfully.
Nov 02 10:25:34 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-737000ca-5874-48d2-9f60-5ac049706198 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-2c0f64d4-08a0-4314-b621-678f833f409c-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-ed9f21c7-375a-49dd-aaf7-96f95dc88ebe-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Lock "cinder-ed9f21c7-375a-49dd-aaf7-96f95dc88ebe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-a047b2a5-e7e6-449e-a231-06907f637589" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-a047b2a5-e7e6-449e-a231-06907f637589" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-ed9f21c7-375a-49dd-aaf7-96f95dc88ebe" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-ed9f21c7-375a-49dd-aaf7-96f95dc88ebe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Deleting offline snapshot ed9f21c7-375a-49dd-aaf7-96f95dc88ebe of volume a047b2a5-e7e6-449e-a231-06907f637589 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] snapshot_file for this snap is: volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[116eb2bf-0a94-4988-8972-079a465ba716]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:35 devstack sudo[108407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe
Nov 02 10:25:35 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-e247c31f-4fd9-4156-91da-b250210d03b5-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-e247c31f-4fd9-4156-91da-b250210d03b5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-e247c31f-4fd9-4156-91da-b250210d03b5" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-e247c31f-4fd9-4156-91da-b250210d03b5" acquired by "delete_volume" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db6f4cd-abc3-42a0-beea-e9fedbc4c993]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:35 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe" returned: 0 in 0.443s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a047b2a5-e7e6-449e-a231-06907f637589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:25:35 devstack sudo[108409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5
Nov 02 10:25:35 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe12c1-5428-47b4-a9b2-ac23c150f25f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:35 devstack sudo[108414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589
Nov 02 10:25:35 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:35 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5" returned: 0 in 0.433s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:35 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:35 devstack sudo[108419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5
Nov 02 10:25:35 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:36 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589" returned: 0 in 0.387s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:36 devstack sudo[108424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe
Nov 02 10:25:36 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:36 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e247c31f-4fd9-4156-91da-b250210d03b5" returned: 0 in 0.283s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-e247c31f-4fd9-4156-91da-b250210d03b5" released by "delete_volume" :: held 0.797s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Created reservations ['0fee04a9-bd9c-490e-9a02-e591cc68e7cf', '785c6723-2d25-4e9f-a981-c22539d2a93d', '66525ae7-ea2c-42c2-bdfb-54292924157b', '4fd94e64-9892-4842-a60d-b1baf11688ef'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:36 devstack sudo[108430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:36 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:36 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe" returned: 0 in 0.418s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:36 devstack sudo[108432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe
Nov 02 10:25:36 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:36 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.383s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:36 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Deleted volume successfully.
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b65e6116-6ba5-4c49-8a3c-0c98f79fc6b4 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-e247c31f-4fd9-4156-91da-b250210d03b5-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:36 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:36 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589.ed9f21c7-375a-49dd-aaf7-96f95dc88ebe" returned: 0 in 0.461s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-ed9f21c7-375a-49dd-aaf7-96f95dc88ebe" released by "_delete_snapshot" :: held 1.838s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-a047b2a5-e7e6-449e-a231-06907f637589" released by "delete_snapshot" :: held 1.866s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Created reservations ['bce9dfa0-2e84-44c8-8c5f-d07b39547da0', 'a62a1cfc-2eba-45fa-861e-c03d4f4d0bd0', 'a3d3f72f-c333-4cc4-8b52-4a200d97b6a4', '94492bad-eb98-46a7-b394-3ba7cfaa0ed4'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:37 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Delete snapshot completed successfully.
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-e71c5ed8-135e-4cd9-ad54-c6ddf49daa20 tempest-ProjectReaderTests-28749545 None] Lock "cinder-ed9f21c7-375a-49dd-aaf7-96f95dc88ebe-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (b443de62-433a-4096-acbe-81f9ce304d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba1c625-9f25-46ca-9a75-14e83ff9114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-a047b2a5-e7e6-449e-a231-06907f637589-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba1c625-9f25-46ca-9a75-14e83ff9114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470128642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d15a02-408b-4475-8c47-55a1ae66ec32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:37Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f13b13-e9f9-4615-9bf7-92479a2107ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f13b13-e9f9-4615-9bf7-92479a2107ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca10535-533b-422d-a160-21433f8689a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca10535-533b-422d-a160-21433f8689a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d15a02-408b-4475-8c47-55a1ae66ec32', 'volume_name': 'volume-27d15a02-408b-4475-8c47-55a1ae66ec32', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407ae13c-092b-4fd8-b24f-74c5980d1b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407ae13c-092b-4fd8-b24f-74c5980d1b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2a721b-f523-494b-b1e1-d9f6f716ef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:37 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Volume 27d15a02-408b-4475-8c47-55a1ae66ec32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d15a02-408b-4475-8c47-55a1ae66ec32', 'volume_size': 1}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470128642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d15a02-408b-4475-8c47-55a1ae66ec32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:37Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Creating volume 27d15a02-408b-4475-8c47-55a1ae66ec32 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:25:37 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Lock "cinder-a047b2a5-e7e6-449e-a231-06907f637589-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:37 devstack sudo[108436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32 1073741824
Nov 02 10:25:37 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Acquiring lock "cinder-quobyte-a047b2a5-e7e6-449e-a231-06907f637589" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-a047b2a5-e7e6-449e-a231-06907f637589" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a29576-0393-4c77-a354-9cab4e495a95]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:37 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:37 devstack sudo[108438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589
Nov 02 10:25:37 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:38 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32 1073741824" returned: 0 in 0.634s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:38 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589" returned: 0 in 0.540s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:38 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32
Nov 02 10:25:38 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:38 devstack sudo[108448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589
Nov 02 10:25:38 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:38 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32" returned: 0 in 0.286s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2a721b-f523-494b-b1e1-d9f6f716ef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d15a02-408b-4475-8c47-55a1ae66ec32', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8858c4-08e6-44eb-b67d-0c9ebb55fa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:38 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a047b2a5-e7e6-449e-a231-06907f637589" returned: 0 in 0.303s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:38 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Volume volume-27d15a02-408b-4475-8c47-55a1ae66ec32 (27d15a02-408b-4475-8c47-55a1ae66ec32): created successfully
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8858c4-08e6-44eb-b67d-0c9ebb55fa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (b443de62-433a-4096-acbe-81f9ce304d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Lock "cinder-quobyte-a047b2a5-e7e6-449e-a231-06907f637589" released by "delete_volume" :: held 0.970s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:38 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ca2a31be-a61c-45ab-86d8-2f5674bd4508 tempest-ProjectMemberTests-1929280023 None] Created volume successfully.
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Created reservations ['1155a4dd-2eca-4d42-a393-c08077111e2c', '6d41e635-fda1-4b4d-9ddb-5f27d92e8ca8', '84e8c5ca-aa15-4569-aea4-15449c80dc32', '2c75d5db-48bf-4642-80ef-29f608dd9ead'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:38 devstack sudo[108453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:38 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:38 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.261s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:38 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Deleted volume successfully.
Nov 02 10:25:38 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-086e189a-b1ce-4625-a2a5-4dd9900cf292 tempest-ProjectReaderTests-28749545 None] Lock "cinder-a047b2a5-e7e6-449e-a231-06907f637589-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:39 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] Creating offline snapshot 31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 of volume 27d15a02-408b-4475-8c47-55a1ae66ec32 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:25:39 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae32db40-ffb3-41c2-a4cb-2880f8aadc4d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:39 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:39 devstack sudo[108457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32
Nov 02 10:25:39 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:40 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32" returned: 0 in 0.455s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:40 devstack sudo[108463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 1G
Nov 02 10:25:40 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:40 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 1G" returned: 0 in 0.463s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27d15a02-408b-4475-8c47-55a1ae66ec32 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:40 devstack sudo[108469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27d15a02-408b-4475-8c47-55a1ae66ec32 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87
Nov 02 10:25:40 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:40 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27d15a02-408b-4475-8c47-55a1ae66ec32 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87" returned: 0 in 0.317s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:40 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 is being set with open permissions: ugo+rw
Nov 02 10:25:40 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:40 devstack sudo[108475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87
Nov 02 10:25:40 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:41 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87" returned: 0 in 0.255s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:41 devstack sudo[108479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.info
Nov 02 10:25:41 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:41 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.info" returned: 0 in 0.262s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:41 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.info is being set with open permissions: ugo+rw
Nov 02 10:25:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:41 devstack sudo[108482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.info
Nov 02 10:25:41 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:41 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.info" returned: 0 in 0.263s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:41 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:41 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-39ead2d6-4d86-42da-8e45-c62178780406 tempest-ProjectMemberTests-1929280023 None] Create snapshot completed successfully
Nov 02 10:25:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Lock "cinder-31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-27d15a02-408b-4475-8c47-55a1ae66ec32" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-27d15a02-408b-4475-8c47-55a1ae66ec32" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:42 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Deleting offline snapshot 31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 of volume 27d15a02-408b-4475-8c47-55a1ae66ec32 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:25:42 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] snapshot_file for this snap is: volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:25:42 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[209801c7-494c-4c55-a577-e412ad92b6a8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:42 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:42 devstack sudo[108485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87
Nov 02 10:25:42 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:43 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87" returned: 0 in 0.370s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27d15a02-408b-4475-8c47-55a1ae66ec32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dfb670-2b93-4930-aac4-8b30a07989c3]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:43 devstack sudo[108491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32
Nov 02 10:25:43 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:43 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32" returned: 0 in 0.385s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:43 devstack sudo[108497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87
Nov 02 10:25:43 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Flow 'volume_create_manager' (243c3b66-27a6-4383-b31c-a98ca28f01ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065b5efa-50c8-43d7-89bb-95b2055a637f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:43 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065b5efa-50c8-43d7-89bb-95b2055a637f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688205675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3bef7d-deb4-4a66-9a9a-7c44ffcde722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e5863f497184eba9c9ef701142d41e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:44Z,use_quota=True,user_id='9f2d98e576e44780a7791d1527cd20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9761766-3065-4dd5-a701-93b59a43c7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9761766-3065-4dd5-a701-93b59a43c7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac1385b-7367-4c26-8c87-b7339d698c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac1385b-7367-4c26-8c87-b7339d698c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a3bef7d-deb4-4a66-9a9a-7c44ffcde722', 'volume_name': 'volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112fa9b4-d2fc-4efa-b0c2-acce5898a2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112fa9b4-d2fc-4efa-b0c2-acce5898a2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6d8147-f4a3-4e55-80f0-f04cd4bca8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:44 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Volume 7a3bef7d-deb4-4a66-9a9a-7c44ffcde722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722', 'volume_size': 1}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688205675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3bef7d-deb4-4a66-9a9a-7c44ffcde722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e5863f497184eba9c9ef701142d41e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:44Z,use_quota=True,user_id='9f2d98e576e44780a7791d1527cd20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Creating volume 7a3bef7d-deb4-4a66-9a9a-7c44ffcde722 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:25:44 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87" returned: 0 in 0.404s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:44 devstack sudo[108502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722 1073741824
Nov 02 10:25:44 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:44 devstack sudo[108503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87
Nov 02 10:25:44 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:44 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32.31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87" returned: 0 in 0.252s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87" released by "_delete_snapshot" :: held 1.523s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-27d15a02-408b-4475-8c47-55a1ae66ec32" released by "delete_snapshot" :: held 1.551s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Created reservations ['cd0d8453-d6b8-4e68-9183-09f1f81d7df8', 'b4a049d0-f9e9-4fcc-80ff-93990fe2961e', '821a2ea8-b10c-466a-83a1-8680717f7c16', '770b45b2-688d-4c8c-a0d6-305c48a9965a'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Delete snapshot completed successfully.
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f2c3b25a-6070-4075-b854-55a1cc4e5cbd tempest-ProjectMemberTests-1929280023 None] Lock "cinder-31f47fbc-3ecf-4f1a-ad4d-f1b07b71df87-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:44 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722 1073741824" returned: 0 in 0.483s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:44 devstack sudo[108511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722
Nov 02 10:25:44 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:44 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722" returned: 0 in 0.257s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6d8147-f4a3-4e55-80f0-f04cd4bca8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1b98d3-a367-491f-b957-f2d8de5bacbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:44 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Volume volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722 (7a3bef7d-deb4-4a66-9a9a-7c44ffcde722): created successfully
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1b98d3-a367-491f-b957-f2d8de5bacbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Flow 'volume_create_manager' (243c3b66-27a6-4383-b31c-a98ca28f01ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5f2685bf-d54b-4a30-a758-ae8361b5ba3a tempest-ProjectReaderTests-1809125761 None] Created volume successfully.
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-27d15a02-408b-4475-8c47-55a1ae66ec32-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-27d15a02-408b-4475-8c47-55a1ae66ec32-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-27d15a02-408b-4475-8c47-55a1ae66ec32" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-27d15a02-408b-4475-8c47-55a1ae66ec32" acquired by "delete_volume" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe5e108-fd52-4f71-a855-69bc6be14411]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:45 devstack sudo[108514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32
Nov 02 10:25:45 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:45 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32" returned: 0 in 0.365s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:45 devstack sudo[108519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32
Nov 02 10:25:45 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:45 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-27d15a02-408b-4475-8c47-55a1ae66ec32" returned: 0 in 0.240s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-27d15a02-408b-4475-8c47-55a1ae66ec32" released by "delete_volume" :: held 0.668s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Created reservations ['58d4ff30-48e9-4dc1-b89f-9cf0f5bb3100', 'd5d87f93-9572-420c-97f9-9bf28cfbcf6b', '56dd9fa9-a3fc-476e-bee0-649d9e0766a0', '65f8be85-12d1-401c-aaac-c00c84ea803f'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:45 devstack sudo[108522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:45 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:46 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.272s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:46 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Deleted volume successfully.
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-8fccc146-f5bd-4e8f-a76c-41e150198de9 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-27d15a02-408b-4475-8c47-55a1ae66ec32-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Acquiring lock "cinder-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Lock "cinder-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Acquiring lock "cinder-quobyte-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Lock "cinder-quobyte-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722" acquired by "delete_volume" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb56d990-a1e5-430e-a8a1-af35ab0d02f9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:46 devstack sudo[108525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722
Nov 02 10:25:46 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (8f0c8f9e-580c-4a0b-a5c8-3acf519e79b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b99af02-1abe-4881-8b6b-e0d0784193bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:46 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b99af02-1abe-4881-8b6b-e0d0784193bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438738130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7926cac8-a57a-4fc4-837e-6474bcde01e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:47Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca39e2a6-c5d4-4093-a09a-5d8065e1aed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca39e2a6-c5d4-4093-a09a-5d8065e1aed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362e9261-de51-4e4d-a207-0121498e0d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362e9261-de51-4e4d-a207-0121498e0d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7926cac8-a57a-4fc4-837e-6474bcde01e1', 'volume_name': 'volume-7926cac8-a57a-4fc4-837e-6474bcde01e1', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408eb35a-01b9-4cef-842d-b0dd9c928ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408eb35a-01b9-4cef-842d-b0dd9c928ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b16f14-ce4f-4372-9314-5c88dd986194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Volume 7926cac8-a57a-4fc4-837e-6474bcde01e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7926cac8-a57a-4fc4-837e-6474bcde01e1', 'volume_size': 1}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438738130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7926cac8-a57a-4fc4-837e-6474bcde01e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:47Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Creating volume 7926cac8-a57a-4fc4-837e-6474bcde01e1 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:25:46 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722" returned: 0 in 0.436s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:46 devstack sudo[108530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 1073741824
Nov 02 10:25:46 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:46 devstack sudo[108531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722
Nov 02 10:25:46 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:46 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722" returned: 0 in 0.249s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Lock "cinder-quobyte-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722" released by "delete_volume" :: held 0.731s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:INSERT=56,cinder:UPDATE=201,cinder:SELECT=161,cinder:DELETE=19 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=175,cinder:INSERT=57,cinder:UPDATE=218,cinder:DELETE=15 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:25:46 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Created reservations ['bb8116d0-dfbd-4772-9403-f968a37bc7f0', '7ed74713-ff38-424e-b1c5-d6cc24241399', 'a33bfe75-f964-4b82-84cb-91e40374d36c', 'd9260d63-42cd-46df-a8cf-e1f00ae8f9fe'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:47 devstack sudo[108539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:47 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:47 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 1073741824" returned: 0 in 0.456s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:47 devstack sudo[108541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1
Nov 02 10:25:47 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:47 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.260s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Deleted volume successfully.
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-7d8944be-9214-4f26-8015-763d054720de tempest-ProjectReaderTests-1809125761 None] Lock "cinder-7a3bef7d-deb4-4a66-9a9a-7c44ffcde722-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:47 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1" returned: 0 in 0.271s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b16f14-ce4f-4372-9314-5c88dd986194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7926cac8-a57a-4fc4-837e-6474bcde01e1', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8173595-e5a4-42f4-8436-4094a9656131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:47 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Volume volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 (7926cac8-a57a-4fc4-837e-6474bcde01e1): created successfully
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8173595-e5a4-42f4-8436-4094a9656131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (8f0c8f9e-580c-4a0b-a5c8-3acf519e79b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fd50eca8-48c5-438f-bbb2-14fbcc0ced19 tempest-ProjectMemberTests-1929280023 None] Created volume successfully.
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Flow 'volume_create_manager' (5b6924fc-e515-4e04-b2f4-a8f982bac48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319ff1c4-da85-486b-a62e-ff32ed593b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] Creating offline snapshot 51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 of volume 7926cac8-a57a-4fc4-837e-6474bcde01e1 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319ff1c4-da85-486b-a62e-ff32ed593b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-898776077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bcaffa-0384-4208-8d84-d007e34f1c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e5863f497184eba9c9ef701142d41e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:48Z,use_quota=True,user_id='9f2d98e576e44780a7791d1527cd20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0c46b7-1b86-4fbf-ac04-1e1e25c4754d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0c46b7-1b86-4fbf-ac04-1e1e25c4754d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae5c14e-19d4-49ae-96d5-d827c2de822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae5c14e-19d4-49ae-96d5-d827c2de822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8bcaffa-0384-4208-8d84-d007e34f1c14', 'volume_name': 'volume-a8bcaffa-0384-4208-8d84-d007e34f1c14', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea40189-95ef-48ba-a8c7-a3f7fb0f7726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea40189-95ef-48ba-a8c7-a3f7fb0f7726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c381629-01e3-4d19-9201-efa3aac0ebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:47 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Volume a8bcaffa-0384-4208-8d84-d007e34f1c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8bcaffa-0384-4208-8d84-d007e34f1c14', 'volume_size': 1}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fab21cc-98ec-4764-bcca-393a16779bf2]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:48 devstack sudo[108545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1
Nov 02 10:25:48 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:48 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1" returned: 0 in 0.361s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:48 devstack sudo[108550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 1G
Nov 02 10:25:48 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:48 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 1G" returned: 0 in 0.394s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:48 devstack sudo[108556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1
Nov 02 10:25:48 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:48 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1" returned: 0 in 0.301s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:48 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 is being set with open permissions: ugo+rw
Nov 02 10:25:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:49 devstack sudo[108562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1
Nov 02 10:25:49 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:49 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1" returned: 0 in 0.228s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:49 devstack sudo[108565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.info
Nov 02 10:25:49 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:49 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.info" returned: 0 in 0.237s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:49 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.info is being set with open permissions: ugo+rw
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:49 devstack sudo[108568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.info
Nov 02 10:25:49 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:49 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.info" returned: 0 in 0.237s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-898776077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bcaffa-0384-4208-8d84-d007e34f1c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e5863f497184eba9c9ef701142d41e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:48Z,use_quota=True,user_id='9f2d98e576e44780a7791d1527cd20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Creating volume a8bcaffa-0384-4208-8d84-d007e34f1c14 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:25:49 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:25:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:49 devstack sudo[108571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14 1073741824
Nov 02 10:25:49 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:49 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-a21f8ca0-cf20-4429-9ff7-44c256873a23 tempest-ProjectMemberTests-1929280023 None] Create snapshot completed successfully
Nov 02 10:25:50 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14 1073741824" returned: 0 in 0.407s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:50 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14
Nov 02 10:25:50 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:50 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14" returned: 0 in 0.228s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c381629-01e3-4d19-9201-efa3aac0ebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8bcaffa-0384-4208-8d84-d007e34f1c14', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8008cd5-8386-4218-9d1b-3c2a0b709a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:50 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Volume volume-a8bcaffa-0384-4208-8d84-d007e34f1c14 (a8bcaffa-0384-4208-8d84-d007e34f1c14): created successfully
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8008cd5-8386-4218-9d1b-3c2a0b709a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Flow 'volume_create_manager' (5b6924fc-e515-4e04-b2f4-a8f982bac48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:50 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-dbe9717d-3dc8-4e58-82c5-21ba23ea98ef tempest-ProjectReaderTests-1809125761 None] Created volume successfully.
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-7926cac8-a57a-4fc4-837e-6474bcde01e1" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Acquiring lock "cinder-a8bcaffa-0384-4208-8d84-d007e34f1c14-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-7926cac8-a57a-4fc4-837e-6474bcde01e1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Lock "cinder-a8bcaffa-0384-4208-8d84-d007e34f1c14-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Deleting offline snapshot 51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 of volume 7926cac8-a57a-4fc4-837e-6474bcde01e1 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] snapshot_file for this snap is: volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cadda84-0401-4c9d-809a-6d97e34317ec]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Acquiring lock "cinder-quobyte-a8bcaffa-0384-4208-8d84-d007e34f1c14" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Lock "cinder-quobyte-a8bcaffa-0384-4208-8d84-d007e34f1c14" acquired by "delete_volume" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddab4696-02ca-4078-b288-0fcccd73fffe]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:51 devstack sudo[108579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1
Nov 02 10:25:51 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:51 devstack sudo[108580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14
Nov 02 10:25:51 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:51 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1" returned: 0 in 0.373s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7926cac8-a57a-4fc4-837e-6474bcde01e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[37848a2b-5c48-4618-8a66-879ec894319c]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:51 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14" returned: 0 in 0.373s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:51 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14
Nov 02 10:25:51 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:51 devstack sudo[108589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1
Nov 02 10:25:51 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:51 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-a8bcaffa-0384-4208-8d84-d007e34f1c14" returned: 0 in 0.249s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Lock "cinder-quobyte-a8bcaffa-0384-4208-8d84-d007e34f1c14" released by "delete_volume" :: held 0.667s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Created reservations ['c1696b20-5b1f-4fc9-98a1-454c38e988d6', '7de05a2d-7b4d-47b7-b2f2-1ae15bfca162', 'c587d115-d892-4a52-ba8d-6dc9cc32f579', '07f15c2d-0b18-40d2-8adb-04db58c19110'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:51 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1" returned: 0 in 0.379s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:51 devstack sudo[108597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1
Nov 02 10:25:51 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:51 devstack sudo[108599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:51 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:52 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.264s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:52 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Deleted volume successfully.
Nov 02 10:25:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-0b8d31bf-287c-44c6-b995-b72ebce53bb9 tempest-ProjectReaderTests-1809125761 None] Lock "cinder-a8bcaffa-0384-4208-8d84-d007e34f1c14-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:52 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1" returned: 0 in 0.389s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:52 devstack sudo[108606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1
Nov 02 10:25:52 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:52 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1.51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1" returned: 0 in 0.251s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1" released by "_delete_snapshot" :: held 1.498s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-7926cac8-a57a-4fc4-837e-6474bcde01e1" released by "delete_snapshot" :: held 1.527s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:52 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Created reservations ['e6004446-af49-475c-a36b-6a203e066982', 'ad4a28e9-140c-4faf-bb3d-abbb540567ed', '0b3b0a03-d7a6-4fe2-aa8a-19cb2923310f', '5a839fa3-5ed4-426e-8e5d-fbfdcb6341be'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Delete snapshot completed successfully.
Nov 02 10:25:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3db4ce01-d5fc-45e2-be6f-1e569c02c1f8 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-51c963d9-dabb-4d13-bc6e-8f0a1fcc28f1-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-7926cac8-a57a-4fc4-837e-6474bcde01e1-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-7926cac8-a57a-4fc4-837e-6474bcde01e1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-7926cac8-a57a-4fc4-837e-6474bcde01e1" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-7926cac8-a57a-4fc4-837e-6474bcde01e1" acquired by "delete_volume" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:53 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67fd423-f801-4ebf-846f-59dadcf0f2f6]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:53 devstack sudo[108609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1
Nov 02 10:25:53 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:53 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1" returned: 0 in 0.369s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:53 devstack sudo[108614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1
Nov 02 10:25:53 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:53 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-7926cac8-a57a-4fc4-837e-6474bcde01e1" returned: 0 in 0.257s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-7926cac8-a57a-4fc4-837e-6474bcde01e1" released by "delete_volume" :: held 0.700s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:53 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Created reservations ['a02ce872-5af6-4caa-ba04-0589bdac894a', 'cc20f2ff-2c3c-45df-a582-ad77de2f96fe', 'f6bc75f2-5bb8-4db6-8b75-6da1b404a57a', 'a0d95516-31c5-4fc8-9ff2-b7910a1cb8bd'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:54 devstack sudo[108617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:25:54 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:54 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.263s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:25:54 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Deleted volume successfully.
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-657a50d2-03bf-4078-ad43-834b5bb7b320 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-7926cac8-a57a-4fc4-837e-6474bcde01e1-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (b3b47fd5-6ef7-4955-838c-fbb174584409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d4bef9-b1ca-42fc-9204-a832ce1eebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d4bef9-b1ca-42fc-9204-a832ce1eebd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307098873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03fd062e-d0db-4ba7-9e93-ac3966271691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:55Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9216576-8e6a-480d-9e70-4783d4346e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9216576-8e6a-480d-9e70-4783d4346e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9498d3-be87-4b2b-b918-604cdf7eabdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9498d3-be87-4b2b-b918-604cdf7eabdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03fd062e-d0db-4ba7-9e93-ac3966271691', 'volume_name': 'volume-03fd062e-d0db-4ba7-9e93-ac3966271691', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d6e1c7-9a20-46e7-b0be-b919774f850e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d6e1c7-9a20-46e7-b0be-b919774f850e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e2d61c-097c-409c-af4d-363e10cff386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:54 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Volume 03fd062e-d0db-4ba7-9e93-ac3966271691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03fd062e-d0db-4ba7-9e93-ac3966271691', 'volume_size': 1}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307098873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03fd062e-d0db-4ba7-9e93-ac3966271691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:25:55Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Creating volume 03fd062e-d0db-4ba7-9e93-ac3966271691 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:25:54 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:25:54 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:54 devstack sudo[108620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691 1073741824
Nov 02 10:25:54 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:55 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691 1073741824" returned: 0 in 0.468s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:55 devstack sudo[108626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691
Nov 02 10:25:55 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:55 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691" returned: 0 in 0.253s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:55 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:25:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e2d61c-097c-409c-af4d-363e10cff386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03fd062e-d0db-4ba7-9e93-ac3966271691', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e52206-6043-48cc-8033-92aef1e75f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:25:55 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Volume volume-03fd062e-d0db-4ba7-9e93-ac3966271691 (03fd062e-d0db-4ba7-9e93-ac3966271691): created successfully
Nov 02 10:25:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e52206-6043-48cc-8033-92aef1e75f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:25:55 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (b3b47fd5-6ef7-4955-838c-fbb174584409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:25:55 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-875561ef-fd10-4d8b-9ecd-7b5c202a40ff tempest-ProjectMemberTests-1929280023 None] Created volume successfully.
Nov 02 10:25:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:25:55 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:25:56 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] Creating offline snapshot dbd98f23-3eb9-4e5e-9425-60d042f38dfc of volume 03fd062e-d0db-4ba7-9e93-ac3966271691 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:25:56 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d85363-8b38-43d4-9ddb-9abb88af0222]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:56 devstack sudo[108629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691
Nov 02 10:25:56 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:56 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691" returned: 0 in 0.386s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:56 devstack sudo[108634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc 1G
Nov 02 10:25:56 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:56 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc 1G" returned: 0 in 0.437s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:56 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03fd062e-d0db-4ba7-9e93-ac3966271691 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:56 devstack sudo[108639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03fd062e-d0db-4ba7-9e93-ac3966271691 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc
Nov 02 10:25:56 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:57 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03fd062e-d0db-4ba7-9e93-ac3966271691 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc" returned: 0 in 0.324s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:57 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc is being set with open permissions: ugo+rw
Nov 02 10:25:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:57 devstack sudo[108644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc
Nov 02 10:25:57 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:57 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc" returned: 0 in 0.255s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:57 devstack sudo[108653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.info
Nov 02 10:25:57 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:57 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.info" returned: 0 in 0.283s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:57 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.info is being set with open permissions: ugo+rw
Nov 02 10:25:57 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:57 devstack sudo[108656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.info
Nov 02 10:25:57 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:57 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.info" returned: 0 in 0.255s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:58 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:25:58 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-36a70e10-19e3-47b3-bcdd-1a1566ebc22b tempest-ProjectMemberTests-1929280023 None] Create snapshot completed successfully
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-dbd98f23-3eb9-4e5e-9425-60d042f38dfc-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-dbd98f23-3eb9-4e5e-9425-60d042f38dfc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-03fd062e-d0db-4ba7-9e93-ac3966271691" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-03fd062e-d0db-4ba7-9e93-ac3966271691" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-dbd98f23-3eb9-4e5e-9425-60d042f38dfc" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-dbd98f23-3eb9-4e5e-9425-60d042f38dfc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Deleting offline snapshot dbd98f23-3eb9-4e5e-9425-60d042f38dfc of volume 03fd062e-d0db-4ba7-9e93-ac3966271691 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] snapshot_file for this snap is: volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d847c24-786e-4adc-9370-2b70380d894d]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:59 devstack sudo[108660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc
Nov 02 10:25:59 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:25:59 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc" returned: 0 in 0.369s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03fd062e-d0db-4ba7-9e93-ac3966271691(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e8d8d2-ef47-4524-8dac-913d56e827c8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:25:59 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:25:59 devstack sudo[108665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691
Nov 02 10:25:59 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:00 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691" returned: 0 in 0.368s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:00 devstack sudo[108670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc
Nov 02 10:26:00 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:00 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc" returned: 0 in 0.388s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:00 devstack sudo[108676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc
Nov 02 10:26:00 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:00 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:00 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691.dbd98f23-3eb9-4e5e-9425-60d042f38dfc" returned: 0 in 0.265s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-dbd98f23-3eb9-4e5e-9425-60d042f38dfc" released by "_delete_snapshot" :: held 1.513s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-03fd062e-d0db-4ba7-9e93-ac3966271691" released by "delete_snapshot" :: held 1.537s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:00 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Created reservations ['a176bf4e-2e0f-4217-bc32-082bb16f7264', '153bf7f8-7aa8-4371-bf86-8dd2c2f62c5e', '2b8159a1-1cf5-449a-86ee-8faf9ed144a2', 'ee5b370e-f6c3-4ba0-8ed5-dd61194b7d67'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:00 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Delete snapshot completed successfully.
Nov 02 10:26:00 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-fa6e9021-a454-4740-920e-dccaa0366a23 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-dbd98f23-3eb9-4e5e-9425-60d042f38dfc-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-03fd062e-d0db-4ba7-9e93-ac3966271691-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-03fd062e-d0db-4ba7-9e93-ac3966271691-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-03fd062e-d0db-4ba7-9e93-ac3966271691" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:01 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-03fd062e-d0db-4ba7-9e93-ac3966271691" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:01 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f5644c-a2fa-46ad-be50-d074338c622f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:01 devstack sudo[108680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691
Nov 02 10:26:01 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:01 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691" returned: 0 in 0.392s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:01 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:01 devstack sudo[108685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691
Nov 02 10:26:01 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:02 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-03fd062e-d0db-4ba7-9e93-ac3966271691" returned: 0 in 0.321s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-03fd062e-d0db-4ba7-9e93-ac3966271691" released by "delete_volume" :: held 0.776s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Created reservations ['168fc5c1-693d-4273-84f7-60098ad0e1c4', '8c91be89-9c9c-4fd7-bb07-28aab9577f15', '0d4b7eb4-1fe1-4dda-b246-4f6375dee3eb', '495a7858-99cd-47d6-a55f-d401f71074e5'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:02 devstack sudo[108688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:26:02 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:02 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.276s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:26:02 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Deleted volume successfully.
Nov 02 10:26:02 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-f7ea73ee-6f7e-4d5c-b7b0-f53e727c5ca6 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-03fd062e-d0db-4ba7-9e93-ac3966271691-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (c0ace1bd-4dd6-487f-94bb-201f13d8a603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6465f1-f3f0-4bcf-bb49-52fec222f31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6465f1-f3f0-4bcf-bb49-52fec222f31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274999946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730b24a7-f78d-4809-afb1-71f8f2508c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:03Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8403b6b-e7e0-440c-be5f-dd212bd6e493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8403b6b-e7e0-440c-be5f-dd212bd6e493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef62d61f-52fd-463c-911b-98958ea20e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef62d61f-52fd-463c-911b-98958ea20e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '730b24a7-f78d-4809-afb1-71f8f2508c1f', 'volume_name': 'volume-730b24a7-f78d-4809-afb1-71f8f2508c1f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb32768-968f-48a1-9291-65f3e981b95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb32768-968f-48a1-9291-65f3e981b95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ab4f4a-ddb5-4833-9763-d050a45c8b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:03 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Volume 730b24a7-f78d-4809-afb1-71f8f2508c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-730b24a7-f78d-4809-afb1-71f8f2508c1f', 'volume_size': 1}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274999946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730b24a7-f78d-4809-afb1-71f8f2508c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:03Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Creating volume 730b24a7-f78d-4809-afb1-71f8f2508c1f {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:26:03 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:03 devstack sudo[108691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f 1073741824
Nov 02 10:26:03 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:03 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f 1073741824" returned: 0 in 0.409s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:03 devstack sudo[108697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f
Nov 02 10:26:03 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:03 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f" returned: 0 in 0.252s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ab4f4a-ddb5-4833-9763-d050a45c8b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-730b24a7-f78d-4809-afb1-71f8f2508c1f', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e679278-21c4-4c5d-b6ee-19539d6f7d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:03 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Volume volume-730b24a7-f78d-4809-afb1-71f8f2508c1f (730b24a7-f78d-4809-afb1-71f8f2508c1f): created successfully
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e679278-21c4-4c5d-b6ee-19539d6f7d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:03 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (c0ace1bd-4dd6-487f-94bb-201f13d8a603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:03 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d17183b3-0cc7-43fe-bc07-a45f71c0bdea tempest-ProjectMemberTests-1929280023 None] Created volume successfully.
Nov 02 10:26:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:04 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] Creating offline snapshot cf5fead6-253b-4851-b449-ac6c42d4c48c of volume 730b24a7-f78d-4809-afb1-71f8f2508c1f {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:26:04 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f33147a-1f03-462b-a66b-541126b4600e]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:04 devstack sudo[108700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f
Nov 02 10:26:04 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:04 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f" returned: 0 in 0.375s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:04 devstack sudo[108705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c 1G
Nov 02 10:26:04 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:04 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c 1G" returned: 0 in 0.391s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:04 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-730b24a7-f78d-4809-afb1-71f8f2508c1f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:05 devstack sudo[108712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-730b24a7-f78d-4809-afb1-71f8f2508c1f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c
Nov 02 10:26:05 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:05 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-730b24a7-f78d-4809-afb1-71f8f2508c1f -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c" returned: 0 in 0.285s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:05 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c is being set with open permissions: ugo+rw
Nov 02 10:26:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:05 devstack sudo[108717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c
Nov 02 10:26:05 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:05 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c" returned: 0 in 0.244s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:05 devstack sudo[108720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.info
Nov 02 10:26:05 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:05 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.info" returned: 0 in 0.246s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:05 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.info is being set with open permissions: ugo+rw
Nov 02 10:26:05 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:05 devstack sudo[108723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.info
Nov 02 10:26:05 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:06 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.info" returned: 0 in 0.242s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:06 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-15a40767-bed9-495a-8b87-76488d335475 tempest-ProjectMemberTests-1929280023 None] Create snapshot completed successfully
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-cf5fead6-253b-4851-b449-ac6c42d4c48c-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Lock "cinder-cf5fead6-253b-4851-b449-ac6c42d4c48c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-730b24a7-f78d-4809-afb1-71f8f2508c1f" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-730b24a7-f78d-4809-afb1-71f8f2508c1f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-cf5fead6-253b-4851-b449-ac6c42d4c48c" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-cf5fead6-253b-4851-b449-ac6c42d4c48c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Deleting offline snapshot cf5fead6-253b-4851-b449-ac6c42d4c48c of volume 730b24a7-f78d-4809-afb1-71f8f2508c1f {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] snapshot_file for this snap is: volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[19856b21-fce9-45c1-ae39-dc5dd13aaedc]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:06 devstack sudo[108726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c
Nov 02 10:26:06 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:06 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c" returned: 0 in 0.361s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-730b24a7-f78d-4809-afb1-71f8f2508c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[83622022-a582-451f-980d-7871d40fd792]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:06 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:06 devstack sudo[108731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f
Nov 02 10:26:06 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:07 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f" returned: 0 in 0.339s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:07 devstack sudo[108736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c
Nov 02 10:26:07 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:07 devstack sudo[108738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:26:07 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:07 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c" returned: 0 in 0.336s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:07 devstack sudo[108743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c
Nov 02 10:26:07 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:07 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.268s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 02 10:26:07 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f.cf5fead6-253b-4851-b449-ac6c42d4c48c" returned: 0 in 0.265s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-cf5fead6-253b-4851-b449-ac6c42d4c48c" released by "_delete_snapshot" :: held 1.397s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-730b24a7-f78d-4809-afb1-71f8f2508c1f" released by "delete_snapshot" :: held 1.418s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Created reservations ['64075330-cb3c-4bfb-bb68-f5e5bb64dc78', 'ddee710d-3502-4ec5-9a62-4e96becab866', '8a64ca16-300d-44f1-8144-ab1a845313af', '3bac7a88-6a23-4edc-ac10-f5125d299ea8'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:07 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Delete snapshot completed successfully.
Nov 02 10:26:07 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-ec4c952e-5d03-4fb6-91c4-e3bf3aecc62f tempest-ProjectMemberTests-1929280023 None] Lock "cinder-cf5fead6-253b-4851-b449-ac6c42d4c48c-delete_snapshot" released by "delete_snapshot" :: held 1.553s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-730b24a7-f78d-4809-afb1-71f8f2508c1f-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-730b24a7-f78d-4809-afb1-71f8f2508c1f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-730b24a7-f78d-4809-afb1-71f8f2508c1f" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:08 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-730b24a7-f78d-4809-afb1-71f8f2508c1f" acquired by "delete_volume" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:08 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[599cc456-efd3-438c-800f-9527dde68358]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:08 devstack sudo[108747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f
Nov 02 10:26:08 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:08 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f" returned: 0 in 0.350s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:08 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:08 devstack sudo[108752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f
Nov 02 10:26:08 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:09 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-730b24a7-f78d-4809-afb1-71f8f2508c1f" returned: 0 in 0.240s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-730b24a7-f78d-4809-afb1-71f8f2508c1f" released by "delete_volume" :: held 0.649s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Created reservations ['517a703e-aac2-489e-bef5-a73bf52e48b0', 'fcacfd5b-3c43-4469-aac1-1639a06bb526', '519d27b8-2360-432c-84ac-998b0e5199f8', 'c3c9c7cf-1c64-4a57-b16a-dc368ee5fe67'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:09 devstack sudo[108756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:26:09 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:09 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.245s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:26:09 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Deleted volume successfully.
Nov 02 10:26:09 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-79ac480c-054d-4c5c-a757-cee26ddbc126 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-730b24a7-f78d-4809-afb1-71f8f2508c1f-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (af3fa309-93c6-4295-9891-65e0a8cf7b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af00696-21b4-4481-8206-9e5d1f47dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af00696-21b4-4481-8206-9e5d1f47dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068186332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:10Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d47d15-d21d-4bdc-8e20-1af61bee8c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d47d15-d21d-4bdc-8e20-1af61bee8c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee8a2b3-fb20-483f-aaa6-1f5289765de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee8a2b3-fb20-483f-aaa6-1f5289765de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96', 'volume_name': 'volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464f4a48-24ca-4da4-9fc0-4fc826b8e180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464f4a48-24ca-4da4-9fc0-4fc826b8e180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72ba573-dbd7-4ad6-9feb-8bd78037c77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:10 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Volume 3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96', 'volume_size': 1}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068186332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:10Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Creating volume 3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:26:10 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:10 devstack sudo[108759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 1073741824
Nov 02 10:26:10 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:10 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 1073741824" returned: 0 in 0.392s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:10 devstack sudo[108764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96
Nov 02 10:26:10 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:10 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96" returned: 0 in 0.238s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72ba573-dbd7-4ad6-9feb-8bd78037c77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cabc37-bb95-40cf-a4ea-a4245fb3552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:10 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Volume volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 (3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96): created successfully
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cabc37-bb95-40cf-a4ea-a4245fb3552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:10 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (af3fa309-93c6-4295-9891-65e0a8cf7b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:10 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-e01b78b1-90ed-4d29-a230-3fe0f612852c tempest-ProjectMemberTests-1929280023 None] Created volume successfully.
Nov 02 10:26:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:11 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] Creating offline snapshot 33d48e71-3be7-4c2f-8200-2ad6326eb69c of volume 3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:26:11 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc669fb-b6d5-4c59-8795-2f9eca32f814]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:11 devstack sudo[108767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96
Nov 02 10:26:11 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:11 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96" returned: 0 in 0.377s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:11 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:11 devstack sudo[108772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c 1G
Nov 02 10:26:11 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:12 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c 1G" returned: 0 in 0.402s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:12 devstack sudo[108777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c
Nov 02 10:26:12 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:12 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c" returned: 0 in 0.267s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:12 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c is being set with open permissions: ugo+rw
Nov 02 10:26:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:12 devstack sudo[108783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c
Nov 02 10:26:12 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:12 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c" returned: 0 in 0.238s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:12 devstack sudo[108786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.info
Nov 02 10:26:12 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:12 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.info" returned: 0 in 0.243s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:12 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.info is being set with open permissions: ugo+rw
Nov 02 10:26:12 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:12 devstack sudo[108789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.info
Nov 02 10:26:12 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:13 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.info" returned: 0 in 0.242s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:13 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-9d39e3ef-f1a5-4c82-8d18-4e241541508a tempest-ProjectMemberTests-1929280023 None] Create snapshot completed successfully
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-33d48e71-3be7-4c2f-8200-2ad6326eb69c-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-33d48e71-3be7-4c2f-8200-2ad6326eb69c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-33d48e71-3be7-4c2f-8200-2ad6326eb69c" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-33d48e71-3be7-4c2f-8200-2ad6326eb69c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Deleting offline snapshot 33d48e71-3be7-4c2f-8200-2ad6326eb69c of volume 3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] snapshot_file for this snap is: volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c1e86e-7eac-46f7-b346-80bd037871ea]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:13 devstack sudo[108792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c
Nov 02 10:26:13 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:13 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c" returned: 0 in 0.355s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1269ae2c-c459-4f62-8b9d-2042aa8ffafe]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:13 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:13 devstack sudo[108797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96
Nov 02 10:26:13 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:14 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96" returned: 0 in 0.353s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:14 devstack sudo[108802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c
Nov 02 10:26:14 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:14 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c" returned: 0 in 0.328s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:14 devstack sudo[108807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c
Nov 02 10:26:14 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:14 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:14 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96.33d48e71-3be7-4c2f-8200-2ad6326eb69c" returned: 0 in 0.233s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-33d48e71-3be7-4c2f-8200-2ad6326eb69c" released by "_delete_snapshot" :: held 1.364s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96" released by "delete_snapshot" :: held 1.384s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:14 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Created reservations ['d968cf85-22af-42c0-a28f-0e85e244cab6', 'affd1c1f-e415-4d92-b5ca-b4137d329cc1', 'c84f3007-718d-4f6e-aa68-d253ddfcb0c1', 'ff3080ec-1ec7-4b22-87f7-7e23cced55cf'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:14 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Delete snapshot completed successfully.
Nov 02 10:26:14 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-d707676b-1df4-45f6-a111-684644976762 tempest-ProjectMemberTests-1929280023 None] Lock "cinder-33d48e71-3be7-4c2f-8200-2ad6326eb69c-delete_snapshot" released by "delete_snapshot" :: held 1.520s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Lock "cinder-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:15 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96" acquired by "delete_volume" :: waited 0.015s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:15 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c3751c-bab0-43ca-953f-234bd600c1b8]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:15 devstack sudo[108810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96
Nov 02 10:26:15 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:15 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96" returned: 0 in 0.352s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:15 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:16 devstack sudo[108815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96
Nov 02 10:26:16 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:16 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96" returned: 0 in 0.232s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96" released by "delete_volume" :: held 0.646s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Created reservations ['91061105-b88f-40ac-b74c-065e4a35b58e', 'c9c1ca43-382d-4462-a4e3-d5a4e424e692', 'd4c40801-d354-408b-b301-ea81996c41ab', 'f1be3742-e3ce-47da-8a03-2845e4cf82db'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:16 devstack sudo[108818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:26:16 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:16 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.249s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:26:16 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Deleted volume successfully.
Nov 02 10:26:16 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-4833bd4a-547f-4ffd-a52d-ad8a077cf13b tempest-ProjectMemberTests-1929280023 None] Lock "cinder-3ef5cb18-f2c6-4ad8-96f8-5da9a38b3e96-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (dc041a64-f092-47ad-b2b8-644d9892a5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c76ca2f-a891-4c22-9f57-72356633b3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c76ca2f-a891-4c22-9f57-72356633b3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472688525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:17Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4facdf79-f062-4d6e-8752-dd4449d7c57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4facdf79-f062-4d6e-8752-dd4449d7c57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fde3b5-bd33-45f2-a30b-9104b459fc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fde3b5-bd33-45f2-a30b-9104b459fc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10', 'volume_name': 'volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57dc3c39-4259-4aba-9b86-7d4066b4c6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57dc3c39-4259-4aba-9b86-7d4066b4c6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ad107d-570a-43ef-85dc-a7508ce80517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:17 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Volume e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10', 'volume_size': 1}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472688525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16daf1b5b9a4467fabaf60140561765e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:17Z,use_quota=True,user_id='7607e3569fe54e07a7af38439a5a676a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Creating volume e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:26:17 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:17 devstack sudo[108821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 1073741824
Nov 02 10:26:17 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:17 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 1073741824" returned: 0 in 0.410s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:17 devstack sudo[108826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10
Nov 02 10:26:17 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:17 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10" returned: 0 in 0.246s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ad107d-570a-43ef-85dc-a7508ce80517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0c6658-d74c-4205-8b36-a37eca9c46b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:17 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Volume volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 (e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10): created successfully
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c0c6658-d74c-4205-8b36-a37eca9c46b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:17 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Flow 'volume_create_manager' (dc041a64-f092-47ad-b2b8-644d9892a5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:17 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3d6d0744-ad3e-4205-963a-fbc8e0e42ce8 tempest-ProjectMemberTests-1929280023 None] Created volume successfully.
Nov 02 10:26:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:18 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] Creating offline snapshot 2921ce05-9346-4e4d-804e-44d75e505de5 of volume e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 {{(pid=87014) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 02 10:26:18 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcadf35-13c0-4ac3-afc9-925b6ade94a9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:18 devstack sudo[108829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10
Nov 02 10:26:18 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:18 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10" returned: 0 in 0.342s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:18 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5 1G {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:18 devstack sudo[108834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5 1G
Nov 02 10:26:18 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:19 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5 1G" returned: 0 in 0.385s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:19 devstack sudo[108840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5
Nov 02 10:26:19 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:19 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 -F qcow2 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5" returned: 0 in 0.291s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:19 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5 is being set with open permissions: ugo+rw
Nov 02 10:26:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:19 devstack sudo[108845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5
Nov 02 10:26:19 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:19 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5" returned: 0 in 0.228s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:19 devstack sudo[108848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.info
Nov 02 10:26:19 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:19 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.info" returned: 0 in 0.237s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:19 devstack cinder-volume[87014]: WARNING cinder.volume.drivers.remotefs [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.info is being set with open permissions: ugo+rw
Nov 02 10:26:19 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.info {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:19 devstack sudo[108851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.info
Nov 02 10:26:19 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:20 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.info" returned: 0 in 0.235s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.794s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:20 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-8323f896-8349-4b0f-b4eb-4446c12e7d6d tempest-ProjectMemberTests-1929280023 None] Create snapshot completed successfully
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-2921ce05-9346-4e4d-804e-44d75e505de5-delete_snapshot" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Lock "cinder-2921ce05-9346-4e4d-804e-44d75e505de5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10" by "delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-2921ce05-9346-4e4d-804e-44d75e505de5" by "_delete_snapshot" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-2921ce05-9346-4e4d-804e-44d75e505de5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Deleting offline snapshot 2921ce05-9346-4e4d-804e-44d75e505de5 of volume e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] snapshot_file for this snap is: volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5 {{(pid=87014) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[29300530-6c62-4a3b-9e5a-bdfcac103eb9]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:20 devstack sudo[108854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5
Nov 02 10:26:20 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:20 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5" returned: 0 in 0.350s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87014) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[badf2725-f95c-44e2-9085-b69adb016f81]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:20 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:21 devstack sudo[108859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10
Nov 02 10:26:21 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:21 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10" returned: 0 in 0.356s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:21 devstack sudo[108864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5
Nov 02 10:26:21 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:21 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5" returned: 0 in 0.346s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:21 devstack sudo[108873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5
Nov 02 10:26:21 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:21 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:21 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10.2921ce05-9346-4e4d-804e-44d75e505de5" returned: 0 in 0.258s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-2921ce05-9346-4e4d-804e-44d75e505de5" released by "_delete_snapshot" :: held 1.405s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:21 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10" released by "delete_snapshot" :: held 1.430s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:22 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Created reservations ['8a36bb9c-57c5-4200-a3a3-557a8c8c05d7', 'fc5dfc88-6547-42ee-9934-a53940bf1f17', '1a04d8e7-4541-4dab-b8ce-11e5444af18a', '4af36bd8-812c-4bc4-8d2a-44f9fdcfe251'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:22 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Delete snapshot completed successfully.
Nov 02 10:26:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-32d79c4b-a6ae-42c7-aea1-5d18e5a3c6dc tempest-ProjectMemberTests-1929280023 None] Lock "cinder-2921ce05-9346-4e4d-804e-44d75e505de5-delete_snapshot" released by "delete_snapshot" :: held 1.565s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Lock "cinder-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Acquiring lock "cinder-quobyte-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:22 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10" acquired by "delete_volume" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:22 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b740e9f-ee42-48e6-931e-a3935e217033]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:22 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:22 devstack sudo[108912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10
Nov 02 10:26:22 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:23 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10" returned: 0 in 0.357s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:23 devstack sudo[108918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10
Nov 02 10:26:23 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:23 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10" returned: 0 in 0.236s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Lock "cinder-quobyte-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10" released by "delete_volume" :: held 0.650s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Created reservations ['08e3c6b9-215e-4beb-a191-c35d8835f936', '1223b68e-8842-4ddf-975a-f8efff2c5957', '4d0f90cc-0a9d-4a5c-8182-5c8155c645f1', '61047ac0-73a5-4071-bff6-d031845c5933'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:23 devstack sudo[108921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:26:23 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:23 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.267s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:26:23 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Deleted volume successfully.
Nov 02 10:26:23 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-3ff75780-bb71-42d4-957e-3aba9ca6df8f tempest-ProjectMemberTests-1929280023 None] Lock "cinder-e4f8c2fa-1d86-4ad6-ac36-b5e4ece2ad10-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:33 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:INSERT=31,cinder:UPDATE=105,cinder:SELECT=79,cinder:DELETE=9 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:26:33 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=79,cinder:INSERT=28,cinder:UPDATE=111,cinder:DELETE=9 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Flow 'volume_create_manager' (42caffd5-5dd7-4d10-987a-8759e8c8f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2114f1-7e33-47ea-9da2-1f7f1f0a59df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2114f1-7e33-47ea-9da2-1f7f1f0a59df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656262242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9827d3f-6ff3-4253-acf6-e8cbc1d0b619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84226188bb064093bcced42bf58207fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:43Z,use_quota=True,user_id='0dc2a8e69d7d48728823a264a32d914e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5659d5-3e9f-4eec-b18a-2cafa83f28c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5659d5-3e9f-4eec-b18a-2cafa83f28c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08999a7-155a-4b06-abe8-9a8cc6ab917e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08999a7-155a-4b06-abe8-9a8cc6ab917e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9827d3f-6ff3-4253-acf6-e8cbc1d0b619', 'volume_name': 'volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befdf511-ce32-4008-b270-8251002a7f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befdf511-ce32-4008-b270-8251002a7f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3374e995-140e-494d-8461-573daff094a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:43 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Volume f9827d3f-6ff3-4253-acf6-e8cbc1d0b619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619', 'volume_size': 1}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656262242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9827d3f-6ff3-4253-acf6-e8cbc1d0b619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84226188bb064093bcced42bf58207fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:43Z,use_quota=True,user_id='0dc2a8e69d7d48728823a264a32d914e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Creating volume f9827d3f-6ff3-4253-acf6-e8cbc1d0b619 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:26:43 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:43 devstack sudo[108928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619 1073741824
Nov 02 10:26:43 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:43 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:43 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619 1073741824" returned: 0 in 0.443s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:44 devstack sudo[108933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619
Nov 02 10:26:44 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:44 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619" returned: 0 in 0.274s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3374e995-140e-494d-8461-573daff094a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fae7f6-e615-44bf-a687-2a5d98f78200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:44 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Volume volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619 (f9827d3f-6ff3-4253-acf6-e8cbc1d0b619): created successfully
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fae7f6-e615-44bf-a687-2a5d98f78200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Flow 'volume_create_manager' (42caffd5-5dd7-4d10-987a-8759e8c8f881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:44 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-74ee059d-5428-43c7-97dc-e3f731db9353 tempest-ProjectReaderTests-1944362416 None] Created volume successfully.
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Acquiring lock "cinder-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Lock "cinder-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Acquiring lock "cinder-quobyte-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Lock "cinder-quobyte-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619" acquired by "delete_volume" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e26fa85-0fe7-4c6a-be64-2b509df59708]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:44 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:44 devstack sudo[108936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619
Nov 02 10:26:44 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:45 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619" returned: 0 in 0.368s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:45 devstack sudo[108941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619
Nov 02 10:26:45 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:45 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619" returned: 0 in 0.250s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Lock "cinder-quobyte-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619" released by "delete_volume" :: held 0.658s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Created reservations ['0aa8a58c-abae-47fb-98d3-c0ae482fa6bb', '9488ff59-6db3-4e52-8baa-289a2f3d5b12', '663c6cc4-0d31-4fe8-8e3c-6ccb1058443f', '080f22d2-2422-49cf-a7f3-5740c8200eb0'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:45 devstack sudo[108944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:26:45 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:45 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.263s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:26:45 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Deleted volume successfully.
Nov 02 10:26:45 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-b71807f4-3353-44a4-a795-bd401feb2b7e tempest-ProjectReaderTests-1944362416 None] Lock "cinder-f9827d3f-6ff3-4253-acf6-e8cbc1d0b619-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Flow 'volume_create_manager' (a95c3f38-7c8d-4980-8d12-bba7765ea675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1209a5d0-bcc5-4b23-8310-b3605fe02082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1209a5d0-bcc5-4b23-8310-b3605fe02082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1845869922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c1d744-380a-4b3a-84ef-b2453cb507fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84226188bb064093bcced42bf58207fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:46Z,use_quota=True,user_id='0dc2a8e69d7d48728823a264a32d914e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40023a84-3241-45a5-8826-70a97827eeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40023a84-3241-45a5-8826-70a97827eeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3599c43-be09-47b9-8bce-2dca96ce9892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3599c43-be09-47b9-8bce-2dca96ce9892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c1d744-380a-4b3a-84ef-b2453cb507fc', 'volume_name': 'volume-30c1d744-380a-4b3a-84ef-b2453cb507fc', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783b9706-c0f0-4196-aa3c-1fe56cdcfe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783b9706-c0f0-4196-aa3c-1fe56cdcfe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48eb9ce-a83d-43e5-bf4b-bdc9219b0915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:46 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Volume 30c1d744-380a-4b3a-84ef-b2453cb507fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c1d744-380a-4b3a-84ef-b2453cb507fc', 'volume_size': 1}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1845869922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c1d744-380a-4b3a-84ef-b2453cb507fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84226188bb064093bcced42bf58207fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:46Z,use_quota=True,user_id='0dc2a8e69d7d48728823a264a32d914e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Creating volume 30c1d744-380a-4b3a-84ef-b2453cb507fc {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:26:46 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:46 devstack sudo[108947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc 1073741824
Nov 02 10:26:46 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:46 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc 1073741824" returned: 0 in 0.422s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:46 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:46 devstack sudo[108952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc
Nov 02 10:26:46 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:47 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc" returned: 0 in 0.243s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48eb9ce-a83d-43e5-bf4b-bdc9219b0915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c1d744-380a-4b3a-84ef-b2453cb507fc', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8cd965-e6f6-4f1d-a68b-fbcda41b56ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:47 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Volume volume-30c1d744-380a-4b3a-84ef-b2453cb507fc (30c1d744-380a-4b3a-84ef-b2453cb507fc): created successfully
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8cd965-e6f6-4f1d-a68b-fbcda41b56ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Flow 'volume_create_manager' (a95c3f38-7c8d-4980-8d12-bba7765ea675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:47 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b4797e97-d89b-4183-bfdd-869866ec0ccf tempest-ProjectReaderTests-1944362416 None] Created volume successfully.
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Acquiring lock "cinder-30c1d744-380a-4b3a-84ef-b2453cb507fc-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Lock "cinder-30c1d744-380a-4b3a-84ef-b2453cb507fc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Acquiring lock "cinder-quobyte-30c1d744-380a-4b3a-84ef-b2453cb507fc" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Lock "cinder-quobyte-30c1d744-380a-4b3a-84ef-b2453cb507fc" acquired by "delete_volume" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b4f95-2360-4aa9-bd5c-73ab56a9196f]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:47 devstack sudo[108955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc
Nov 02 10:26:47 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:47 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc" returned: 0 in 0.346s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:47 devstack sudo[108960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc
Nov 02 10:26:47 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:47 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-30c1d744-380a-4b3a-84ef-b2453cb507fc" returned: 0 in 0.246s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:47 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Lock "cinder-quobyte-30c1d744-380a-4b3a-84ef-b2453cb507fc" released by "delete_volume" :: held 0.630s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Created reservations ['1e8fcc35-12ba-4128-9ac5-dee32b042d07', 'ab438b57-48b6-44fc-bca5-ee4e9a8fadc6', '1e769093-82df-4139-8f5e-c5d568052504', 'b4235b35-075a-4731-8795-7186b7c9ddd9'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:48 devstack sudo[108963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:26:48 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:48 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.231s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:26:48 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Deleted volume successfully.
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-abf877f7-2821-4079-8497-87a1c98b3d0e tempest-ProjectReaderTests-1944362416 None] Lock "cinder-30c1d744-380a-4b3a-84ef-b2453cb507fc-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Flow 'volume_create_manager' (e00a6bf2-a0c1-44e8-a50f-ce9b6125e000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bb56e5-476b-4d25-a74f-d0e3d66d536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bb56e5-476b-4d25-a74f-d0e3d66d536d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216753053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84feedb0-d9d5-4341-a7e8-49bc7a941d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84226188bb064093bcced42bf58207fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:49Z,use_quota=True,user_id='0dc2a8e69d7d48728823a264a32d914e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2687ba4-2bf4-4770-8b8b-3665ad779af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2687ba4-2bf4-4770-8b8b-3665ad779af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43b10be-fe86-45d2-8880-fd2d8c930677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43b10be-fe86-45d2-8880-fd2d8c930677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84feedb0-d9d5-4341-a7e8-49bc7a941d98', 'volume_name': 'volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd136b95-0519-4812-aa6e-2443944635b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd136b95-0519-4812-aa6e-2443944635b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a634ef-404c-49ca-af2c-a89f31e2b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:48 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Volume 84feedb0-d9d5-4341-a7e8-49bc7a941d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98', 'volume_size': 1}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216753053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84feedb0-d9d5-4341-a7e8-49bc7a941d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84226188bb064093bcced42bf58207fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:49Z,use_quota=True,user_id='0dc2a8e69d7d48728823a264a32d914e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Creating volume 84feedb0-d9d5-4341-a7e8-49bc7a941d98 {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:26:48 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:26:48 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:48 devstack sudo[108966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98 1073741824
Nov 02 10:26:48 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:49 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98 1073741824" returned: 0 in 0.429s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:49 devstack sudo[108972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98
Nov 02 10:26:49 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:49 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98" returned: 0 in 0.228s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:49 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:26:49 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:49 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a634ef-404c-49ca-af2c-a89f31e2b05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:49 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0769cb-d5ff-4d6b-b0af-4d59e358b702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:49 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Volume volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98 (84feedb0-d9d5-4341-a7e8-49bc7a941d98): created successfully
Nov 02 10:26:49 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0769cb-d5ff-4d6b-b0af-4d59e358b702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:49 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Flow 'volume_create_manager' (e00a6bf2-a0c1-44e8-a50f-ce9b6125e000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:49 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-b475c190-620c-47d8-aa74-4388b3b3ce45 tempest-ProjectReaderTests-1944362416 None] Created volume successfully.
Nov 02 10:26:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Acquiring lock "cinder-84feedb0-d9d5-4341-a7e8-49bc7a941d98-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:49 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Lock "cinder-84feedb0-d9d5-4341-a7e8-49bc7a941d98-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Acquiring lock "cinder-quobyte-84feedb0-d9d5-4341-a7e8-49bc7a941d98" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Lock "cinder-quobyte-84feedb0-d9d5-4341-a7e8-49bc7a941d98" acquired by "delete_volume" :: waited 0.014s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45c8fed-fa89-44e3-9875-f2c145f411af]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:50 devstack sudo[108975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98
Nov 02 10:26:50 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:50 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98" returned: 0 in 0.352s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:50 devstack sudo[108980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98
Nov 02 10:26:50 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:50 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-84feedb0-d9d5-4341-a7e8-49bc7a941d98" returned: 0 in 0.243s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Lock "cinder-quobyte-84feedb0-d9d5-4341-a7e8-49bc7a941d98" released by "delete_volume" :: held 0.647s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Created reservations ['1581ffea-a867-4edb-adca-bc40d2f7f32d', 'c43b4f50-0080-4605-9659-84491e185aa5', '0dbc9830-d051-4c85-91a3-0e1006a38646', 'cd546b76-dd81-4e27-8653-2b242ebaada2'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:50 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:50 devstack sudo[108983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:26:50 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:51 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.238s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:26:51 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Deleted volume successfully.
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-82afd245-9c01-4878-9c22-1b1a07385e5f tempest-ProjectReaderTests-1944362416 None] Lock "cinder-84feedb0-d9d5-4341-a7e8-49bc7a941d98-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87014) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Flow 'volume_create_manager' (010626be-4bb4-41dd-b5c9-00aeebb5c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3074add1-4692-4292-9869-d2ef17d24e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3074add1-4692-4292-9869-d2ef17d24e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691141818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84226188bb064093bcced42bf58207fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:52Z,use_quota=True,user_id='0dc2a8e69d7d48728823a264a32d914e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ddef22-605a-499c-8f8e-3b901becffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ddef22-605a-499c-8f8e-3b901becffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8e8967-53b1-479f-a116-1603a03a18d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8e8967-53b1-479f-a116-1603a03a18d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e', 'volume_name': 'volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8ee038-ea23-4f98-b4df-e23482e977ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8ee038-ea23-4f98-b4df-e23482e977ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cb6367-95b6-43a8-b5b7-bacbcf458bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:51 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Volume 1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e', 'volume_size': 1}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x754f39b03d10>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-02T09:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691141818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84226188bb064093bcced42bf58207fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:26:52Z,use_quota=True,user_id='0dc2a8e69d7d48728823a264a32d914e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a63bc7-3fcb-42fb-9775-f84577d296df),volume_type_id=c1a63bc7-3fcb-42fb-9775-f84577d296df)}" {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.remotefs [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Creating volume 1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e {{(pid=87014) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Selected osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74 as target Quobyte volume. {{(pid=87014) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 02 10:26:51 devstack cinder-volume[87014]: INFO cinder.volume.drivers.remotefs [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] casted to osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74
Nov 02 10:26:51 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e 1073741824 {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:51 devstack sudo[108986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e 1073741824
Nov 02 10:26:51 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:52 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e 1073741824" returned: 0 in 0.419s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:52 devstack sudo[108991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e
Nov 02 10:26:52 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:52 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e" returned: 0 in 0.225s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'} {{(pid=87014) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cb6367-95b6-43a8-b5b7-bacbcf458bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e', 'volume_size': 1}' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a9e935-dc26-43a0-b2d2-b27188f9d081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 02 10:26:52 devstack cinder-volume[87014]: INFO cinder.volume.flows.manager.create_volume [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Volume volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e (1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e): created successfully
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a9e935-dc26-43a0-b2d2-b27188f9d081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87014) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Flow 'volume_create_manager' (010626be-4bb4-41dd-b5c9-00aeebb5c940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87014) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 02 10:26:52 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-5b899e01-8dd8-4b3b-a893-9c69564f75e4 tempest-ProjectReaderTests-1944362416 None] Created volume successfully.
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Acquiring lock "cinder-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e-delete_volume" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Lock "cinder-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Acquiring lock "cinder-quobyte-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e" by "delete_volume" {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Lock "cinder-quobyte-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e" acquired by "delete_volume" :: waited 0.016s {{(pid=87014) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG oslo.privsep.daemon [-] privsep: reply[43436896-db41-490b-b7a2-bf5c3e17c494]: (4, 'qcow2') {{(pid=88737) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 02 10:26:52 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:52 devstack sudo[108994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e
Nov 02 10:26:52 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:53 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e" returned: 0 in 0.342s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:53 devstack sudo[108999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e
Nov 02 10:26:53 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:53 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a/volume-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e" returned: 0 in 0.223s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Lock "cinder-quobyte-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e" released by "delete_volume" :: held 0.604s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG cinder.quota [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Created reservations ['b25ff77e-12dd-4ca6-9a79-3b58a5f1da48', '3e9dd0c6-7bb5-4548-abd6-7c1eeba95ed0', '88ca15b6-89d3-4db8-b95d-f9865dfe1958', '6ba64b19-ecd7-42ef-986d-9d49743b189d'] {{(pid=87014) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:26:53 devstack sudo[109002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:26:53 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:26:53 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.232s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:26:53 devstack cinder-volume[87014]: INFO cinder.volume.manager [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Deleted volume successfully.
Nov 02 10:26:53 devstack cinder-volume[87014]: DEBUG cinder.coordination [None req-1b6bf78e-9b5e-4a02-8af6-03de4df1ac8c tempest-ProjectReaderTests-1944362416 None] Lock "cinder-1fc8f1e2-1a1f-4b99-9e2f-458e19d7682e-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87014) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 02 10:27:03 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=30,cinder:UPDATE=36,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:27:03 devstack cinder-volume[87014]: DEBUG dbcounter [-] [87014] Writing DB stats cinder:SELECT=26,cinder:UPDATE=52,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87014) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74': None} {{(pid=87014) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG cinder.volume.drivers.quobyte [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5bbefe01-4a7c-4564-9526-1a28ae5e1d74'] {{(pid=87014) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.lockutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87014) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 02 10:27:07 devstack sudo[109019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a
Nov 02 10:27:07 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 02 10:27:07 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG oslo_concurrency.processutils [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1503a4ab54a351c03fb5f45d5d7907a" returned: 0 in 0.242s {{(pid=87014) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG cinder.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Notifying Schedulers of capabilities ... {{(pid=87014) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG oslo_service.periodic_task [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] Running periodic task VolumeManager._thread_info {{(pid=87014) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread count: 29 {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 02 10:27:07 devstack cinder-volume[87014]: DEBUG cinder.volume.manager [None req-0a7366b5-fe57-46a2-a225-c791be801515 None None] thread info: [<_MainThread(MainThread, started 128983244976256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128983130961344)>, <Thread(Thread-3 (stat_writer), started daemon 128983131318464)>, <Thread(Rabbit-heartbeat, started daemon 128983130367680)>, <Thread(Thread-5 (_runner), started daemon 128983128611328)>, <Thread(Thread-7 (_runner), started daemon 128983128705280)>, <Thread(fd_logger, started daemon 128983127981632)>, <Thread(privsep_reader, started daemon 128983124624448)>, <Thread(Rabbit-heartbeat, started daemon 128983125112896)>, <Thread(tpool_thread_0, started daemon 128983121118912)>, <Thread(tpool_thread_1, started daemon 128983112726208)>, <Thread(tpool_thread_2, started daemon 128983104317120)>, <Thread(tpool_thread_3, started daemon 128983095908032)>, <Thread(tpool_thread_4, started daemon 128983087498944)>, <Thread(tpool_thread_5, started daemon 128983079089856)>, <Thread(tpool_thread_6, started daemon 128983070680768)>, <Thread(tpool_thread_7, started daemon 128983062271680)>, <Thread(tpool_thread_8, started daemon 128983053862592)>, <Thread(tpool_thread_9, started daemon 128983045453504)>, <Thread(tpool_thread_10, started daemon 128983037044416)>, <Thread(tpool_thread_11, started daemon 128983028635328)>, <Thread(tpool_thread_12, started daemon 128983020226240)>, <Thread(tpool_thread_13, started daemon 128983011817152)>, <Thread(tpool_thread_14, started daemon 128983003408064)>, <Thread(tpool_thread_15, started daemon 128982994998976)>, <Thread(tpool_thread_16, started daemon 128982986589888)>, <Thread(tpool_thread_17, started daemon 128982978180800)>, <Thread(tpool_thread_18, started daemon 128982969771712)>, <Thread(tpool_thread_19, started daemon 128982961362624)>] {{(pid=87014) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}